Original Authors: Belinda Phipson, Anna Trigos, Matt Ritchie, Maria Doyle, Harriet Dashnow, Charity Law Based on the course RNAseq analysis in R delivered on May 11/12th 2016

Before starting this section, we will make sure we have all the relevant objects from the Differential Expression analysis present.

suppressPackageStartupMessages(library(edgeR))
load("Robjects/DE.Rdata")

Overview

  • Visualising DE results
  • Getting annotation
  • Retrieving gene models
  • Exporting browser traecks
  • Visualising results with respect to genomic location

We have a list of significantly differentially expressed genes, but the only annotation we can see is the Entrez Gene ID, which is not very informative.

results <- as.data.frame(topTags(lrt.BvsL,n = Inf))
results

edgeR provides a function plotSmear that allows us to visualise the results of a DE analysis. In a similar manner to the MA-plot for microarray data, this plot shows the log-fold change against log-counts per million, with DE genes highlighted:

summary(de <- decideTestsDGE(lrt.BvsL))
   [,1]
-1 2404
0  9583
1  1322
detags <- rownames(dgeObj)[as.logical(de)]
plotSmear(lrt.BvsL, de.tags=detags)

However, on such a plot it would be nice to add labels to highlight the genes with most evidence for being DE, or our favourite genes. To perform such a task we need to map between the identifiers we have in the edgeR output and more familiar names.

Finally, we will look at sophisticated visualisations that allow us to incorporate information about the structure of a gene, level of sequencing coverage.

Adding annotation to the edgeR results

There are a number of ways to add annotation, but we will demonstrate how to do this using the org.Mm.eg.db package. This package is one of several organism-level packages which are re-built every 6 months. These packages are listed on the annotation section of the Bioconductor, and are installed in the same way as regular Bioconductor packages. An alternative approach is to use biomaRt, an interface to the BioMart resource. BioMart is much more comprehensive, but the organism package fit better into the Bioconductor workflow.

source("http://www.bioconductor.org/biocLite.R")
biocLite("org.Mm.eg.db")
# For Human
biocLite("org.Hs.eg.db")

The packages are larger in size that Bioconductor software pacakges, but essentially they are databases that can be used to make offline queries.

library(org.Mm.eg.db)

First we need to decide what information we want. In order to see what we can extract we can run the columns function on the annotation database.

columns(org.Mm.eg.db)
 [1] "ACCNUM"       "ALIAS"        "ENSEMBL"      "ENSEMBLPROT"  "ENSEMBLTRANS" "ENTREZID"     "ENZYME"      
 [8] "EVIDENCE"     "EVIDENCEALL"  "GENENAME"     "GO"           "GOALL"        "IPI"          "MGI"         
[15] "ONTOLOGY"     "ONTOLOGYALL"  "PATH"         "PFAM"         "PMID"         "PROSITE"      "REFSEQ"      
[22] "SYMBOL"       "UNIGENE"      "UNIPROT"     

We are going to filter the database by a key or set of keys in order to extract the information we want. Valid names for the key can be retrieved with the keytypes function.

keytypes(org.Mm.eg.db)
 [1] "ACCNUM"       "ALIAS"        "ENSEMBL"      "ENSEMBLPROT"  "ENSEMBLTRANS" "ENTREZID"     "ENZYME"      
 [8] "EVIDENCE"     "EVIDENCEALL"  "GENENAME"     "GO"           "GOALL"        "IPI"          "MGI"         
[15] "ONTOLOGY"     "ONTOLOGYALL"  "PATH"         "PFAM"         "PMID"         "PROSITE"      "REFSEQ"      
[22] "SYMBOL"       "UNIGENE"      "UNIPROT"     

We should see ENTREZID, which is the type of key we are going to use in this case. If we are unsure what values are acceptable for the key, we can check what keys are valid with keys

keys(org.Mm.eg.db, keytype="ENTREZID")[1:10]
 [1] "11287" "11298" "11302" "11303" "11304" "11305" "11306" "11307" "11308" "11350"

It is a useful sanity check to make sure that the keys you want to use are all valid. We could use %in% in this case.

## Build up the query step-by-step
my.keys <- c("50916", "110308","12293")
my.keys %in% keys(org.Mm.eg.db, keytype="ENTREZID")
[1] TRUE TRUE TRUE
all(my.keys %in% keys(org.Mm.eg.db, keytype="ENTREZID"))
[1] TRUE

Let’s build up the query step by step.

## to be filled-in interactively during the class.
select(org.Mm.eg.db,

To annotate our results, we definitely want gene symbols and perhaps the full gene name. Let’s build up our annotation information in a separate data frame using the select function.

ann <- select(org.Mm.eg.db,keys=rownames(results),columns=c("ENTREZID","SYMBOL","GENENAME"))
'select()' returned 1:1 mapping between keys and columns
# Have a look at the annotation
ann

Let’s double check that the ENTREZID column matches exactly to our results rownames.

table(ann$ENTREZID==rownames(results))

 TRUE 
13309 

We can bind in the annotation information to the results data frame. (Please note that if the select function returns a 1:many mapping then you can’t just append the annotation to the fit object.)

results.annotated <- cbind(results, ann)
results.annotated

We can save the results table using the write.csv function, which writes the results out to a csv file that you can open in excel.

write.csv(results.annotated,file="B.PregVsLacResults.csv",row.names=FALSE)

A note about deciding how many genes are significant: In order to decide which genes are differentially expressed, we usually take a cut-off of 0.05 on the adjusted p-value, NOT the raw p-value. This is because we are testing more than 15000 genes, and the chances of finding differentially expressed genes is very high when you do that many tests. Hence we need to control the false discovery rate, which is the adjusted p-value column in the results table. What this means is that if 100 genes are significant at a 5% false discovery rate, we are willing to accept that 5 will be false positives. Note that the decideTests function displays significant genes at 5% FDR.

Challenge

Re-visit the plotSmear plot from above and use the text function to add labels for the names of the top 200 most DE genes

Another common visualisation is the volcano plot which display a measure of significance on the y-axis and fold-change on the x-axis.

signif <- -log10(results.annotated$FDR)
plot(results.annotated$logFC,signif,pch=16)
points(results.annotated[detags,"logFC"],-log10(results.annotated[detags,"FDR"]),pch=16,col="red")

Before following up on the DE genes with further lab work, a recommended sanity check is to have a look at the expression levels of the individual samples for the genes of interest. We can quickly look at grouped expression using stripchart. We can use the normalised log expression values in the dgeCounts object (dgeCounts$counts).

library(RColorBrewer)
par(mfrow=c(1,3))
normCounts <- dgeObj$counts
# Let's look at the first gene in the topTable, Irx4, which has a rowname 50916
stripchart(normCounts["50916",]~group)
# This plot is ugly, let's make it better
stripchart(normCounts["50916",]~group,vertical=TRUE,las=2,cex.axis=0.8,pch=16,col=1:6,method="jitter")
# Let's use nicer colours
nice.col <- brewer.pal(6,name="Dark2")
stripchart(normCounts["50916",]~group,vertical=TRUE,las=2,cex.axis=0.8,pch=16,cex=1.3,col=nice.col,method="jitter",ylab="Normalised log2 expression",main=" Irx4")

An interactive version of the volcano plot above that includes the raw per sample values in a separate panel is possible via the glXYPlot function in the Glimma package.

library(Glimma)
group2 <- group
levels(group2) <- c("basal.lactate","basal.preg","basal.virgin","lum.lactate", "lum.preg", "lum.virgin")
glXYPlot(x=results$logFC, y=-log10(results$FDR),
         xlab="logFC", ylab="B", main="B.PregVsLac",
         counts=normCounts, groups=group2, status=de,
         anno=ann, id.column="ENTREZID", folder="volcano")

This function creates an html page (./volcano/XY-Plot.html) with a volcano plot on the left and a plot showing the log-CPM per sample for a selected gene on the right. A search bar is available to search for genes of interest.

Retrieving Genomic Locations

It might seem natural to add genomic locations to our annotation table, and possibly a bit odd that the org.Mm.eg.db package does not supply such mappings. In fact, there is a whole suite of package for performing this, and more-advanced queries. These are listed on the Bioconductor annotation page and have the prefix TxDb.

The package we will be using is TxDb.Mmusculus.UCSC.mm10.knownGene. Packages are available for other organisms and genome builds. It is even possible to build your own database if one does not exist. See vignette("GenomicFeatures") for details

source("http://www.bioconductor.org/biocLite.R")
biocLite("TxDb.Mmusculus.UCSC.mm10.knownGene")

## For Humans
biocLite("TxDb.Hsapiens.UCSC.hg19.knownGene")

We load the library in the usual fashion and create a new object to save some typing. As with the org. packages, we can query what columns are available with columns,

library(TxDb.Mmusculus.UCSC.mm10.knownGene)
tx <- TxDb.Mmusculus.UCSC.mm10.knownGene
columns(tx)
 [1] "CDSCHROM"   "CDSEND"     "CDSID"      "CDSNAME"    "CDSSTART"   "CDSSTRAND"  "EXONCHROM"  "EXONEND"   
 [9] "EXONID"     "EXONNAME"   "EXONRANK"   "EXONSTART"  "EXONSTRAND" "GENEID"     "TXCHROM"    "TXEND"     
[17] "TXID"       "TXNAME"     "TXSTART"    "TXSTRAND"   "TXTYPE"    

The select function is used in the same manner as the org.Mm.eg.db packages.

Challenge

Use the TxDb.Mmusculus.UCSC.mm10.knownGene package to retrieve the exon coordinates for the genes 50916, 110308, 12293

Overview of GenomicRanges

One of the real strengths of the txdb.. packages is the ability of interface with GenomicRanges, which is the object type used throughout Bioconductor to manipulate Genomic Intervals.

These object types permit us to perform common operations on intervals such as overlapping and counting.

library(GenomicRanges)
my.range <-GRanges("chr1", IRanges(start=1000,end=2000))
my.range
GRanges object with 1 range and 0 metadata columns:
      seqnames       ranges strand
         <Rle>    <IRanges>  <Rle>
  [1]     chr1 [1000, 2000]      *
  -------
  seqinfo: 1 sequence from an unspecified genome; no seqlengths

Let’s try some dummy intervals with random chromsome assignments and start positions.

set.seed(05052017)
chrs <- sample(paste0("chr",1:19),100,replace=TRUE)
startPos <- sample(1:5e6,100,replace=TRUE)
my.rangesA <- GRanges(chrs, IRanges(start=startPos,width=1000))
my.rangesA
GRanges object with 100 ranges and 0 metadata columns:
        seqnames             ranges strand
           <Rle>          <IRanges>  <Rle>
    [1]    chr17 [2732950, 2733949]      *
    [2]     chr3 [2250749, 2251748]      *
    [3]    chr15 [2581981, 2582980]      *
    [4]     chr4 [3439502, 3440501]      *
    [5]    chr15 [2851346, 2852345]      *
    ...      ...                ...    ...
   [96]     chr8 [  35930,   36929]      *
   [97]    chr13 [ 644034,  645033]      *
   [98]    chr15 [1278939, 1279938]      *
   [99]     chr2 [3348995, 3349994]      *
  [100]     chr5 [4484841, 4485840]      *
  -------
  seqinfo: 18 sequences from an unspecified genome; no seqlengths

There are a number of useful functions for calculating properties of the data (such as coverage or sorting). It is even possible to convert between different chromosome naming conventions.

width(my.rangesA)
  [1] 1000 1000 1000 1000 1000 1000 1000 1000 1000 1000 1000 1000 1000 1000 1000 1000 1000 1000 1000 1000 1000
 [22] 1000 1000 1000 1000 1000 1000 1000 1000 1000 1000 1000 1000 1000 1000 1000 1000 1000 1000 1000 1000 1000
 [43] 1000 1000 1000 1000 1000 1000 1000 1000 1000 1000 1000 1000 1000 1000 1000 1000 1000 1000 1000 1000 1000
 [64] 1000 1000 1000 1000 1000 1000 1000 1000 1000 1000 1000 1000 1000 1000 1000 1000 1000 1000 1000 1000 1000
 [85] 1000 1000 1000 1000 1000 1000 1000 1000 1000 1000 1000 1000 1000 1000 1000 1000
sort(my.rangesA)
GRanges object with 100 ranges and 0 metadata columns:
        seqnames             ranges strand
           <Rle>          <IRanges>  <Rle>
    [1]    chr17 [ 571363,  572362]      *
    [2]    chr17 [1125242, 1126241]      *
    [3]    chr17 [1338513, 1339512]      *
    [4]    chr17 [2732950, 2733949]      *
    [5]     chr3 [ 609141,  610140]      *
    ...      ...                ...    ...
   [96]    chr14 [1658130, 1659129]      *
   [97]    chr14 [3037287, 3038286]      *
   [98]    chr14 [3805150, 3806149]      *
   [99]    chr14 [4853072, 4854071]      *
  [100]     chr7 [3795787, 3796786]      *
  -------
  seqinfo: 18 sequences from an unspecified genome; no seqlengths
coverage(my.rangesA)
RleList of length 18
$chr17
integer-Rle of length 2733949 with 8 runs
  Lengths:  571362    1000  552879    1000  212271    1000 1393437    1000
  Values :       0       1       0       1       0       1       0       1

$chr3
integer-Rle of length 3387478 with 6 runs
  Lengths:  609140    1000 1640608    1000 1134730    1000
  Values :       0       1       0       1       0       1

$chr15
integer-Rle of length 4431853 with 20 runs
  Lengths:   21661    1000  135948    1000  133119    1000 ...  210004    1000  184691    1000  390271    1000
  Values :       0       1       0       1       0       1 ...       0       1       0       1       0       1

$chr4
integer-Rle of length 4744112 with 10 runs
  Lengths:  271227    1000 1796879    1000 1101428    1000  266967    1000 1302611    1000
  Values :       0       1       0       1       0       1       0       1       0       1

$chr6
integer-Rle of length 4526564 with 12 runs
  Lengths: 1810833    1000  571823    1000 1073193    1000  554296    1000  141906    1000  368513    1000
  Values :       0       1       0       1       0       1       0       1       0       1       0       1

...
<13 more elements>
seqlevelsStyle(my.rangesA)
[1] "UCSC"
keepSeqlevels(my.rangesA,"chr19")
GRanges object with 2 ranges and 0 metadata columns:
      seqnames             ranges strand
         <Rle>          <IRanges>  <Rle>
  [1]    chr19 [3107336, 3108335]      *
  [2]    chr19 [3918859, 3919858]      *
  -------
  seqinfo: 1 sequence from an unspecified genome; no seqlengths
#seqlevelsStyle(my.rangesA) <- "Ensembl"
#my.rangesA
my.rangesB <- shift(my.rangesA, shift = 500)
my.rangesB <- resize(my.rangesB,width =sample(1:1000,100,replace = TRUE))
my.rangesB
GRanges object with 100 ranges and 0 metadata columns:
        seqnames             ranges strand
           <Rle>          <IRanges>  <Rle>
    [1]    chr17 [2733450, 2734037]      *
    [2]     chr3 [2251249, 2251485]      *
    [3]    chr15 [2582481, 2582952]      *
    [4]     chr4 [3440002, 3440135]      *
    [5]    chr15 [2851846, 2852015]      *
    ...      ...                ...    ...
   [96]     chr8 [  36430,   37283]      *
   [97]    chr13 [ 644534,  645469]      *
   [98]    chr15 [1279439, 1280030]      *
   [99]     chr2 [3349495, 3350125]      *
  [100]     chr5 [4485341, 4486290]      *
  -------
  seqinfo: 18 sequences from an unspecified genome; no seqlengths
findOverlaps(my.rangesA,my.rangesB)
Hits object with 100 hits and 0 metadata columns:
        queryHits subjectHits
        <integer>   <integer>
    [1]         1           1
    [2]         2           2
    [3]         3           3
    [4]         4           4
    [5]         5           5
    ...       ...         ...
   [96]        96          96
   [97]        97          97
   [98]        98          98
   [99]        99          99
  [100]       100         100
  -------
  queryLength: 100 / subjectLength: 100

Retrieving Gene Coordinates as GenomicRanges

It is quite straightforward to translate the output of a select query into a GenomicFeatures object. However, several convenience functions exist to retrieve the structure of every gene for a given organism in one object.

The output of exonsBy is a list, where each item in the list is the exon co-ordinates of a particular gene.

exo <- exonsBy(tx,"gene")
exo
GRangesList object of length 24116:
$100009600 
GRanges object with 7 ranges and 2 metadata columns:
      seqnames               ranges strand |   exon_id   exon_name
         <Rle>            <IRanges>  <Rle> | <integer> <character>
  [1]     chr9 [21062393, 21062717]      - |    134539        <NA>
  [2]     chr9 [21062894, 21062987]      - |    134540        <NA>
  [3]     chr9 [21063314, 21063396]      - |    134541        <NA>
  [4]     chr9 [21066024, 21066377]      - |    134542        <NA>
  [5]     chr9 [21066940, 21067925]      - |    134543        <NA>
  [6]     chr9 [21068030, 21068117]      - |    134544        <NA>
  [7]     chr9 [21073075, 21075496]      - |    134546        <NA>

$100009609 
GRanges object with 6 ranges and 2 metadata columns:
      seqnames               ranges strand | exon_id exon_name
  [1]     chr7 [84940169, 84941088]      - |  109989      <NA>
  [2]     chr7 [84943141, 84943264]      - |  109990      <NA>
  [3]     chr7 [84943504, 84943722]      - |  109991      <NA>
  [4]     chr7 [84946200, 84947000]      - |  109992      <NA>
  [5]     chr7 [84947372, 84947651]      - |  109993      <NA>
  [6]     chr7 [84963816, 84964009]      - |  109994      <NA>

$100009614 
GRanges object with 1 range and 2 metadata columns:
      seqnames               ranges strand | exon_id exon_name
  [1]    chr10 [77711446, 77712009]      + |  143986      <NA>

...
<24113 more elements>
-------
seqinfo: 66 sequences (1 circular) from mm10 genome

To access the structure of a particular gene, we can use the [[ syntax with the name of the gene (Entrez gene ID) within quote marks.

exo[["12992"]]
GRanges object with 14 ranges and 2 metadata columns:
       seqnames               ranges strand |   exon_id   exon_name
          <Rle>            <IRanges>  <Rle> | <integer> <character>
   [1]     chr5 [87808121, 87808165]      + |     68233        <NA>
   [2]     chr5 [87809897, 87809959]      + |     68234        <NA>
   [3]     chr5 [87813088, 87813114]      + |     68235        <NA>
   [4]     chr5 [87813838, 87813861]      + |     68236        <NA>
   [5]     chr5 [87813941, 87813982]      + |     68237        <NA>
   ...      ...                  ...    ... .       ...         ...
  [10]     chr5 [87819066, 87819095]      + |     68242        <NA>
  [11]     chr5 [87819066, 87819110]      + |     68243        <NA>
  [12]     chr5 [87820951, 87820995]      + |     68244        <NA>
  [13]     chr5 [87822212, 87822322]      + |     68245        <NA>
  [14]     chr5 [87824139, 87824421]      + |     68246        <NA>
  -------
  seqinfo: 66 sequences (1 circular) from mm10 genome

Exporting tracks

It is also possible to save the results of a Bioconductor analysis in a browser to enable interactive analysis and integration with other data types, or sharing with collaborators. For instance, we might want a browser track to indicate where our differentially-expressed genes are located. We shall use the bed format to display these locations. We will annotate the ranges with information from our analysis such as the fold-change and significance.

First we create a data frame for just the DE genes.

sigGenes <- results.annotated[detags,]
sigGenes

At the moment, we have a GenomicFeatures object that represents every exon. However, we do not need this level of granularity for the bed output, so we will collapse to a single region for each gene. First we the range function to obtain a single range for every gene and tranform to a more convenient object with unlist.

range(exo)
GRangesList object of length 24116:
$100009600 
GRanges object with 1 range and 0 metadata columns:
      seqnames               ranges strand
         <Rle>            <IRanges>  <Rle>
  [1]     chr9 [21062393, 21075496]      -

$100009609 
GRanges object with 1 range and 0 metadata columns:
      seqnames               ranges strand
  [1]     chr7 [84940169, 84964009]      -

$100009614 
GRanges object with 1 range and 0 metadata columns:
      seqnames               ranges strand
  [1]    chr10 [77711446, 77712009]      +

...
<24113 more elements>
-------
seqinfo: 66 sequences (1 circular) from mm10 genome
exoRanges <- unlist(range(exo))
sigRegions <- exoRanges[na.omit(match(sigGenes$ENTREZID, names(exoRanges)))]
sigRegions
GRanges object with 3631 ranges and 0 metadata columns:
         seqnames                 ranges strand
            <Rle>              <IRanges>  <Rle>
  497097     chr1   [ 3214482,  3671498]      -
   20671     chr1   [ 4490928,  4497354]      -
   58175     chr1   [ 4909576,  5070285]      -
   76187     chr1   [ 9548046,  9577968]      +
  329093     chr1   [10324719, 10719945]      -
     ...      ...                    ...    ...
   24004     chrX [161717036, 161779494]      +
  195727     chrX [161836430, 162159441]      -
  108012     chrX [163909017, 163933666]      +
   56078     chrX [163976822, 164028010]      -
   54156     chrX [166523007, 166585716]      -
  -------
  seqinfo: 66 sequences (1 circular) from mm10 genome

Rather than just representing the genomic locations, the .bed format is also able to colour each range according to some property of the analysis (e.g. direction and magnitude of change) to help highlight particular regions of interest. A score can also be displayed when a particular region is clicked-on. A useful propery of GenomicRanges is that we can attach metadata to each range using the mcols function. The metadata can be supplied in the form of a data frame.

sigRegions
GRanges object with 3631 ranges and 0 metadata columns:
         seqnames                 ranges strand
            <Rle>              <IRanges>  <Rle>
  497097     chr1   [ 3214482,  3671498]      -
   20671     chr1   [ 4490928,  4497354]      -
   58175     chr1   [ 4909576,  5070285]      -
   76187     chr1   [ 9548046,  9577968]      +
  329093     chr1   [10324719, 10719945]      -
     ...      ...                    ...    ...
   24004     chrX [161717036, 161779494]      +
  195727     chrX [161836430, 162159441]      -
  108012     chrX [163909017, 163933666]      +
   56078     chrX [163976822, 164028010]      -
   54156     chrX [166523007, 166585716]      -
  -------
  seqinfo: 66 sequences (1 circular) from mm10 genome
mcols(sigRegions) <- sigGenes[match(names(sigRegions), rownames(sigGenes)),]
sigRegions
GRanges object with 3631 ranges and 8 metadata columns:
         seqnames                 ranges strand |      logFC    logCPM        LR          PValue          FDR
            <Rle>              <IRanges>  <Rle> |  <numeric> <numeric> <numeric>       <numeric>    <numeric>
  497097     chr1   [ 3214482,  3671498]      - | -10.957852 2.5399009 23.996441 0.0000009651394 0.0003318385
   20671     chr1   [ 4490928,  4497354]      - |  -2.699254 1.2552475 11.604336 0.0006579824848 0.0049983384
   58175     chr1   [ 4909576,  5070285]      - |   4.446657 1.1156958 15.123070 0.0001007248591 0.0013499971
   76187     chr1   [ 9548046,  9577968]      + |   3.006701 2.3986789  8.637321 0.0032934535098 0.0168586818
  329093     chr1   [10324719, 10719945]      - |  -9.274801 0.8109447 23.423913 0.0000012995305 0.0003318385
     ...      ...                    ...    ... .        ...       ...       ...             ...          ...
   24004     chrX [161717036, 161779494]      + |  -4.732945  5.098343 18.502627  0.000016967024 0.0005074475
  195727     chrX [161836430, 162159441]      - |  -4.719770  3.121463 14.165446  0.000167416949 0.0018661241
  108012     chrX [163909017, 163933666]      + |  -2.202415  2.332431 10.992919  0.000914606307 0.0064032064
   56078     chrX [163976822, 164028010]      - |   2.561963  5.127930  6.832299  0.008952394552 0.0356844669
   54156     chrX [166523007, 166585716]      - |  -6.988927  4.406488 19.589937  0.000009597338 0.0004093941
            ENTREZID      SYMBOL                                           GENENAME
         <character> <character>                                        <character>
  497097      497097        Xkr4                  X-linked Kx blood group related 4
   20671       20671       Sox17              SRY (sex determining region Y)-box 17
   58175       58175       Rgs20                regulator of G-protein signaling 20
   76187       76187      Adhfe1          alcohol dehydrogenase, iron containing, 1
  329093      329093        Cpa6                                carboxypeptidase A6
     ...         ...         ...                                                ...
   24004       24004        Rai2                            retinoic acid induced 2
  195727      195727         Nhs                       Nance-Horan syndrome (human)
  108012      108012       Ap1s2 adaptor-related protein complex 1, sigma 2 subunit
   56078       56078       Car5b               carbonic anhydrase 5b, mitochondrial
   54156       54156       Egfl6                        EGF-like-domain, multiple 6
  -------
  seqinfo: 66 sequences (1 circular) from mm10 genome

The metadata we have added can also by used as a means to interrogate the ranges; as if the data were contained in a data frame.

sigRegions[order(sigRegions$LR,decreasing = TRUE)]
GRanges object with 3631 ranges and 8 metadata columns:
         seqnames                 ranges strand |     logFC    logCPM        LR          PValue          FDR
            <Rle>              <IRanges>  <Rle> | <numeric> <numeric> <numeric>       <numeric>    <numeric>
   50916    chr13 [ 73260497,  73269620]      + | -8.661954  5.765299  24.93188 0.0000005939198 0.0003318385
  110308    chr15 [101707070, 101712891]      - | -8.966144 10.279551  24.86932 0.0000006135098 0.0003318385
   12293     chr5 [ 15934691,  16374511]      + | -8.387523  6.810055  24.73701 0.0000006571001 0.0003318385
   56069    chr18 [ 61687915,  61692537]      + | -8.445139  6.139673  24.59682 0.0000007066808 0.0003318385
   24117    chr10 [121034004, 121100642]      + | -9.316466  6.772437  24.34662 0.0000008046782 0.0003318385
     ...      ...                    ...    ... .       ...       ...       ...             ...          ...
   68556     chr2 [181569153, 181581973]      - | -1.246824 4.4596086  6.053256      0.01388068   0.04963407
  328949    chr18 [ 44425060,  44812182]      - |  1.309854 3.7913109  6.051290      0.01389614   0.04967600
   15950     chr1 [173920401, 173942672]      - | -1.736769 0.8073257  6.042508      0.01396543   0.04991030
   57339     chr1 [ 16994940,  17097889]      - | -1.359820 2.2429739  6.039127      0.01399220   0.04998949
   18828     chr9 [ 92275602,  92297752]      + |  2.116508 5.3033567  6.038761      0.01399510   0.04998949
            ENTREZID      SYMBOL                                                   GENENAME
         <character> <character>                                                <character>
   50916       50916        Irx4                   Iroquois related homeobox 4 (Drosophila)
  110308      110308        Krt5                                                  keratin 5
   12293       12293    Cacna2d1 calcium channel, voltage-dependent, alpha2/delta subunit 1
   56069       56069       Il17b                                            interleukin 17B
   24117       24117        Wif1                                    Wnt inhibitory factor 1
     ...         ...         ...                                                        ...
   68556       68556       Uckl1                           uridine-cytidine kinase 1-like 1
  328949      328949         Mcc                              mutated in colorectal cancers
   15950       15950      Ifi203                              interferon activated gene 203
   57339       57339        Jph1                                             junctophilin 1
   18828       18828      Plscr2                                  phospholipid scramblase 2
  -------
  seqinfo: 66 sequences (1 circular) from mm10 genome

For visualisation purposes, we are going to restrict the data to genes that are located on chromosomes 1 to 19 and the sex chromosomes. This can be done with the keepSeqLevels function.

seqlevels(sigRegions)
 [1] "chr1"                 "chr2"                 "chr3"                 "chr4"                
 [5] "chr5"                 "chr6"                 "chr7"                 "chr8"                
 [9] "chr9"                 "chr10"                "chr11"                "chr12"               
[13] "chr13"                "chr14"                "chr15"                "chr16"               
[17] "chr17"                "chr18"                "chr19"                "chrX"                
[21] "chrY"                 "chrM"                 "chr1_GL456210_random" "chr1_GL456211_random"
[25] "chr1_GL456212_random" "chr1_GL456213_random" "chr1_GL456221_random" "chr4_GL456216_random"
[29] "chr4_GL456350_random" "chr4_JH584292_random" "chr4_JH584293_random" "chr4_JH584294_random"
[33] "chr4_JH584295_random" "chr5_GL456354_random" "chr5_JH584296_random" "chr5_JH584297_random"
[37] "chr5_JH584298_random" "chr5_JH584299_random" "chr7_GL456219_random" "chrX_GL456233_random"
[41] "chrY_JH584300_random" "chrY_JH584301_random" "chrY_JH584302_random" "chrY_JH584303_random"
[45] "chrUn_GL456239"       "chrUn_GL456359"       "chrUn_GL456360"       "chrUn_GL456366"      
[49] "chrUn_GL456367"       "chrUn_GL456368"       "chrUn_GL456370"       "chrUn_GL456372"      
[53] "chrUn_GL456378"       "chrUn_GL456379"       "chrUn_GL456381"       "chrUn_GL456382"      
[57] "chrUn_GL456383"       "chrUn_GL456385"       "chrUn_GL456387"       "chrUn_GL456389"      
[61] "chrUn_GL456390"       "chrUn_GL456392"       "chrUn_GL456393"       "chrUn_GL456394"      
[65] "chrUn_GL456396"       "chrUn_JH584304"      
sigRegions <- keepSeqlevels(sigRegions, paste0("chr", c(1:19,"X","Y")))

We will now create a score from the p-values that will displayed under each region, and colour scheme for the regions based on the fold-change. For the score we can use the \(-log_{10}\) of the adjusted p-value as before

Score <- -log10(sigRegions$FDR)

colorRampPalette is a useful function in base R for constructing a palette between two extremes. When choosing colour palettes, make sure they are colour blind friendly. The red / green colour scheme traditionally-applied to microarrays is a bad choice.

We will also truncate the fold-changes to between -5 and 5 to and divide this range into 10 equal bins

rbPal <-colorRampPalette(c("red", "blue"))
logfc <- pmax(sigRegions$logFC, -5)
logfc <- pmin(logfc , 5)
Col <- rbPal(10)[as.numeric(cut(logfc, breaks = 10))]

The colours and score have to be saved in the GRanges object as score and itemRgb columns respectively, and will be used to construct the browser track. The rtracklayer package can be used to import and export browsers tracks.

Now we can export the signifcant results from the DE analysis as a .bed track using rtracklayer. You can load the resulting file in IGV, if you wish.

mcols(sigRegions)$score <- Score
mcols(sigRegions)$itemRgb <- Col
sigRegions
GRanges object with 3630 ranges and 10 metadata columns:
         seqnames                 ranges strand |      logFC    logCPM        LR          PValue          FDR
            <Rle>              <IRanges>  <Rle> |  <numeric> <numeric> <numeric>       <numeric>    <numeric>
  497097     chr1   [ 3214482,  3671498]      - | -10.957852 2.5399009 23.996441 0.0000009651394 0.0003318385
   20671     chr1   [ 4490928,  4497354]      - |  -2.699254 1.2552475 11.604336 0.0006579824848 0.0049983384
   58175     chr1   [ 4909576,  5070285]      - |   4.446657 1.1156958 15.123070 0.0001007248591 0.0013499971
   76187     chr1   [ 9548046,  9577968]      + |   3.006701 2.3986789  8.637321 0.0032934535098 0.0168586818
  329093     chr1   [10324719, 10719945]      - |  -9.274801 0.8109447 23.423913 0.0000012995305 0.0003318385
     ...      ...                    ...    ... .        ...       ...       ...             ...          ...
   24004     chrX [161717036, 161779494]      + |  -4.732945  5.098343 18.502627  0.000016967024 0.0005074475
  195727     chrX [161836430, 162159441]      - |  -4.719770  3.121463 14.165446  0.000167416949 0.0018661241
  108012     chrX [163909017, 163933666]      + |  -2.202415  2.332431 10.992919  0.000914606307 0.0064032064
   56078     chrX [163976822, 164028010]      - |   2.561963  5.127930  6.832299  0.008952394552 0.0356844669
   54156     chrX [166523007, 166585716]      - |  -6.988927  4.406488 19.589937  0.000009597338 0.0004093941
            ENTREZID      SYMBOL                                           GENENAME     score     itemRgb
         <character> <character>                                        <character> <numeric> <character>
  497097      497097        Xkr4                  X-linked Kx blood group related 4  3.479073     #FF0000
   20671       20671       Sox17              SRY (sex determining region Y)-box 17  2.301174     #C60038
   58175       58175       Rgs20                regulator of G-protein signaling 20  2.869667     #0000FF
   76187       76187      Adhfe1          alcohol dehydrogenase, iron containing, 1  1.773176     #1C00E2
  329093      329093        Cpa6                                carboxypeptidase A6  3.479073     #FF0000
     ...         ...         ...                                                ...       ...         ...
   24004       24004        Rai2                            retinoic acid induced 2  3.294609     #FF0000
  195727      195727         Nhs                       Nance-Horan syndrome (human)  2.729059     #FF0000
  108012      108012       Ap1s2 adaptor-related protein complex 1, sigma 2 subunit  2.193602     #C60038
   56078       56078       Car5b               carbonic anhydrase 5b, mitochondrial  1.447521     #3800C6
   54156       54156       Egfl6                        EGF-like-domain, multiple 6  3.387858     #FF0000
  -------
  seqinfo: 21 sequences from mm10 genome
library(rtracklayer)
export(sigRegions , con = "topHits.bed")

Extracting Reads

As we have been using counts as our starting point, we haven’t investigated the aligned reads from our experiment, and how they are represented. As you may be aware, aligned reads are usually stored in a bam file that can be manipulated with open-source command-line tools such as samtools and picard. Bioconductor provide a low-level interface to bam/sam files in the form of the Rsamtools package. The GenomicAlignments package can also be used to retrieve the reads mapping to a particular genomic region in an efficient manner.

library(GenomicAlignments)
generegion <- exo[["50916"]]
getwd()
bam <- readGAlignments(file="bam/MCL1.DG.bam",
                       param=ScanBamParam(which=generegion))
bam

There are various visualisation options for aligned reads and range data. We will use the ggbio package, which first requires some discussion of the ggplot2 plotting package.

Brief Introduction to ggplot2

The ggplot2 package has emerged as an attractive alternative to the traditional plots provided by base R. A full overview of all capabilities of the package is available from the cheatsheet.

A simple scatter plot, equivalent to plotSmear from before, can be generated as follows:-

library(ggplot2)
ggplot(results, aes(x = logCPM, y=logFC)) + geom_point() 

In brief:-

  • results is our data frame containing the variables we wish to plot
  • aes creates a mpping between the variables in our data frame to the aesthetic proprties of the plot
    • the x-axis is mapped to logCPM, y-axis is mapped to logFC
  • geom_point specifies the particular type of plot we want (in this case a scatter plot)

The real advantage of ggplot2 is the ability to change the appearance of our plot by mapping other variables to aspects of the plot. For example, we could colour the points based on a p-value cut-off. The colours are automatically chosen by ggplot2, but we can specifiy particular values.

ggplot(results, aes(x = logCPM, y=logFC,col=FDR < 0.05)) + geom_point()

ggplot(results, aes(x = logCPM, y=logFC,col=FDR < 0.05)) + geom_point(alpha=0.4) + scale_colour_manual(values=c("black","red"))

ggplot(results, aes(x = logCPM, y=logFC,col=FDR < 0.05)) + geom_point() + scale_colour_manual(values=c("black","red"))

The volcano plot can be constructed in a similar manner

ggplot(results, aes(x = logFC, y=-log10(FDR))) + geom_point()

Composing plots with ggbio

We will now take a brief look at one of the visualisation packages in Bioconductor that takes advantage of the GenomicRanges and GenomicFeatures object-types. In this section we will show a worked example of how to combine several types of genomic data on the same plot. The documentation for ggbio is very extensive and contains lots of examples.

http://www.tengfei.name/ggbio/docs/

The Gviz package is another Bioconductor package that specialising in genomic visualisations, but we will not explore this package in the course.

The Manhattan plot is a common way of visualising genome-wide results, and this is implemented as the plotGrandLinear function. We have to supply a value to display on the y-axis using the aes function, which is inherited from ggplot2. The positioning of points on the x-axis is handled automatically by ggbio, using the ranges information to get the genomic coordinates of the ranges of interest.

To stop the plots from being too cluttered we will consider the top 200 genes only.

library(ggbio)
top200 <- sigRegions[order(sigRegions$LR,decreasing = TRUE)[1:200]]
plotGrandLinear(top200 , aes(y = logFC))
using coord:genome to parse x scale

ggbio has alternated the colours of the chromosomes. However, an appealing feature of ggplot2 is the ability to map properties of your plot to variables present in your data. For example, we could create a variable to distinguish between up- and down-regulated genes. The variables used for aesthetic mapping must be present in the mcols section of your ranges object.

mcols(top200)$UpRegulated <- mcols(top200)$logFC > 0
plotGrandLinear(top200, aes(y = logFC, col = UpRegulated))
using coord:genome to parse x scale

plotGrandLinear is a special function in ggbio with preset options for the manhattan style of plot. More often, users will call the autoplot function and ggbio will choose the most appropriate layout. One such layout is the karyogram.

autoplot(top200,layout="karyogram",aes(color=UpRegulated,
                                       fill=UpRegulated))
Scale for 'x' is already present. Adding another scale for 'x', which will replace the existing scale.
Scale for 'x' is already present. Adding another scale for 'x', which will replace the existing scale.

ggbio is also able to plot the structure of genes according to a particular model represented by a GenomicFeatures object.

autoplot(tx, which=exo[["24117"]])

We can even plot the location of sequencing reads if they have been imported using readGAlignments function (or similar).

myreg <- flank(reduce(exo[["24117"]]), 1000, both = T)
bam <- readGAlignments(file="bam/MCL1.DG.bam",
                       param=ScanBamParam(which=myreg),use.names = TRUE)

autoplot(bam,which=myreg)
autoplot(bam , stat = "coverage")

Like ggplot2, ggbio plots can be saved as objects that can later be modified, or combined together to form more complicated plots. If saved in this way, the plot will only be displayed on a plotting device when we query the object. This strategy is useful when we want to add a common element (such as an ideogram) to a plot composition and don’t want to repeat the code to generate the plot every time.

#idPlot <- plotIdeogram(genome = "mm10")
#idPlot
geneMod <- autoplot(tx, which = myreg)
reads1 <- autoplot(bam, stat = "coverage")
tracks(geneMod ,reads1)
LS0tCnRpdGxlOiAiUk5BLXNlcSBBbmFseXNpcyBpbiBSIgpzdWJ0aXRsZTogIkFubm90YXRpb24gYW5kIFZpc3VhbGlzYXRpb24gb2YgUk5BLXNlcSByZXN1bHRzIgphdXRob3I6ICJTdGVwaGFuZSBCYWxsZXJlYXUsIE1hcmsgRHVubmluZywgT3NjYXIgUnVlZGEsIEFzaGxleSBTYXdsZSIKZGF0ZTogJ2ByIGZvcm1hdChTeXMudGltZSgpLCAiTGFzdCBtb2RpZmllZDogJWQgJWIgJVkiKWAnCm91dHB1dDoKICBodG1sX25vdGVib29rOgogICAgdG9jOiB5ZXMKICAgIHRvY19mbG9hdDogeWVzCiAgaHRtbF9kb2N1bWVudDoKICAgIHRvYzogeWVzCiAgICB0b2NfZmxvYXQ6IHllcwptaW51dGVzOiAzMDAKbGF5b3V0OiBwYWdlCmJpYmxpb2dyYXBoeTogcmVmLmJpYgotLS0KYGBge3Igc2V0dXAsIGluY2x1ZGU9RkFMU0V9CmtuaXRyOjpvcHRzX2NodW5rJHNldChlY2hvID0gVFJVRSkKYGBgCgoqKk9yaWdpbmFsIEF1dGhvcnM6IEJlbGluZGEgUGhpcHNvbiwgQW5uYSBUcmlnb3MsIE1hdHQgUml0Y2hpZSwgTWFyaWEgRG95bGUsIEhhcnJpZXQgRGFzaG5vdywgQ2hhcml0eSBMYXcqKgpCYXNlZCBvbiB0aGUgY291cnNlIFtSTkFzZXEgYW5hbHlzaXMgaW4gUl0oaHR0cDovL2NvbWJpbmUtYXVzdHJhbGlhLmdpdGh1Yi5pby8yMDE2LTA1LTExLVJOQXNlcS8pIGRlbGl2ZXJlZCBvbiBNYXkgMTEvMTJ0aCAyMDE2CgpCZWZvcmUgc3RhcnRpbmcgdGhpcyBzZWN0aW9uLCB3ZSB3aWxsIG1ha2Ugc3VyZSB3ZSBoYXZlIGFsbCB0aGUgcmVsZXZhbnQgb2JqZWN0cyBmcm9tIHRoZSBEaWZmZXJlbnRpYWwgRXhwcmVzc2lvbiBhbmFseXNpcyBwcmVzZW50LgoKYGBge3J9CnN1cHByZXNzUGFja2FnZVN0YXJ0dXBNZXNzYWdlcyhsaWJyYXJ5KGVkZ2VSKSkKbG9hZCgiUm9iamVjdHMvREUuUmRhdGEiKQpgYGAKCiMgT3ZlcnZpZXcKCi0gVmlzdWFsaXNpbmcgREUgcmVzdWx0cwotIEdldHRpbmcgYW5ub3RhdGlvbgotIFJldHJpZXZpbmcgZ2VuZSBtb2RlbHMKLSBFeHBvcnRpbmcgYnJvd3NlciB0cmFlY2tzCi0gVmlzdWFsaXNpbmcgcmVzdWx0cyB3aXRoIHJlc3BlY3QgdG8gZ2Vub21pYyBsb2NhdGlvbgoKCgpXZSBoYXZlIGEgbGlzdCBvZiBzaWduaWZpY2FudGx5IGRpZmZlcmVudGlhbGx5IGV4cHJlc3NlZCBnZW5lcywgYnV0IHRoZSBvbmx5IGFubm90YXRpb24gd2UgY2FuIHNlZSBpcyB0aGUgRW50cmV6IEdlbmUgSUQsIHdoaWNoIGlzIG5vdCB2ZXJ5IGluZm9ybWF0aXZlLiAKYGBge3J9CnJlc3VsdHMgPC0gYXMuZGF0YS5mcmFtZSh0b3BUYWdzKGxydC5CdnNMLG4gPSBJbmYpKQpyZXN1bHRzCgpgYGAKCmBlZGdlUmAgcHJvdmlkZXMgYSBmdW5jdGlvbiBgcGxvdFNtZWFyYCB0aGF0IGFsbG93cyB1cyB0byB2aXN1YWxpc2UgdGhlIHJlc3VsdHMgb2YgYSBERSBhbmFseXNpcy4gSW4gYSBzaW1pbGFyIG1hbm5lciB0byB0aGUgWypNQS1wbG90KiBmb3IgbWljcm9hcnJheSBkYXRhXShodHRwczovL2VuLndpa2lwZWRpYS5vcmcvd2lraS9NQV9wbG90KSwgdGhpcyBwbG90IHNob3dzIHRoZSBsb2ctZm9sZCBjaGFuZ2UgYWdhaW5zdCBsb2ctY291bnRzIHBlciBtaWxsaW9uLCB3aXRoIERFIGdlbmVzIGhpZ2hsaWdodGVkOgoKYGBge3J9CnN1bW1hcnkoZGUgPC0gZGVjaWRlVGVzdHNER0UobHJ0LkJ2c0wpKQpkZXRhZ3MgPC0gcm93bmFtZXMoZGdlT2JqKVthcy5sb2dpY2FsKGRlKV0KcGxvdFNtZWFyKGxydC5CdnNMLCBkZS50YWdzPWRldGFncykKYGBgCkhvd2V2ZXIsIG9uIHN1Y2ggYSBwbG90IGl0IHdvdWxkIGJlIG5pY2UgdG8gYWRkIGxhYmVscyB0byBoaWdobGlnaHQgdGhlIGdlbmVzIHdpdGggbW9zdCBldmlkZW5jZSBmb3IgYmVpbmcgREUsIG9yIG91ciBmYXZvdXJpdGUgZ2VuZXMuIFRvIHBlcmZvcm0gc3VjaCBhIHRhc2sgd2UgbmVlZCB0byBtYXAgYmV0d2VlbiB0aGUgaWRlbnRpZmllcnMgd2UgaGF2ZSBpbiB0aGUgYGVkZ2VSYCBvdXRwdXQgYW5kIG1vcmUgZmFtaWxpYXIgbmFtZXMuCgpGaW5hbGx5LCB3ZSB3aWxsIGxvb2sgYXQgc29waGlzdGljYXRlZCB2aXN1YWxpc2F0aW9ucyB0aGF0IGFsbG93IHVzIHRvIGluY29ycG9yYXRlIGluZm9ybWF0aW9uIGFib3V0IHRoZSBzdHJ1Y3R1cmUgb2YgYSBnZW5lLCBsZXZlbCBvZiBzZXF1ZW5jaW5nIGNvdmVyYWdlLgoKIyMgQWRkaW5nIGFubm90YXRpb24gdG8gdGhlIGVkZ2VSIHJlc3VsdHMKClRoZXJlIGFyZSBhIG51bWJlciBvZiB3YXlzIHRvIGFkZCBhbm5vdGF0aW9uLCBidXQgd2Ugd2lsbCBkZW1vbnN0cmF0ZSBob3cgdG8gZG8gdGhpcyB1c2luZyB0aGUgKm9yZy5NbS5lZy5kYiogcGFja2FnZS4gVGhpcyBwYWNrYWdlIGlzIG9uZSBvZiBzZXZlcmFsICpvcmdhbmlzbS1sZXZlbCogcGFja2FnZXMgd2hpY2ggYXJlIHJlLWJ1aWx0IGV2ZXJ5IDYgbW9udGhzLiBUaGVzZSBwYWNrYWdlcyBhcmUgbGlzdGVkIG9uIHRoZSBbYW5ub3RhdGlvbiBzZWN0aW9uXShodHRwOi8vYmlvY29uZHVjdG9yLm9yZy9wYWNrYWdlcy9yZWxlYXNlL0Jpb2NWaWV3cy5odG1sI19fX0Fubm90YXRpb25EYXRhKSBvZiB0aGUgQmlvY29uZHVjdG9yLCBhbmQgYXJlIGluc3RhbGxlZCBpbiB0aGUgc2FtZSB3YXkgYXMgcmVndWxhciBCaW9jb25kdWN0b3IgcGFja2FnZXMuIEFuIGFsdGVybmF0aXZlIGFwcHJvYWNoIGlzIHRvIHVzZSBgYmlvbWFSdGAsIGFuIGludGVyZmFjZSB0byB0aGUgW0Jpb01hcnRdKGh0dHA6Ly93d3cuYmlvbWFydC5vcmcvKSByZXNvdXJjZS4gQmlvTWFydCBpcyBtdWNoIG1vcmUgY29tcHJlaGVuc2l2ZSwgYnV0IHRoZSBvcmdhbmlzbSBwYWNrYWdlIGZpdCBiZXR0ZXIgaW50byB0aGUgQmlvY29uZHVjdG9yIHdvcmtmbG93LgoKCmBgYHtyIGV2YWw9RkFMU0V9CnNvdXJjZSgiaHR0cDovL3d3dy5iaW9jb25kdWN0b3Iub3JnL2Jpb2NMaXRlLlIiKQpiaW9jTGl0ZSgib3JnLk1tLmVnLmRiIikKIyBGb3IgSHVtYW4KYmlvY0xpdGUoIm9yZy5Icy5lZy5kYiIpCmBgYAoKVGhlIHBhY2thZ2VzIGFyZSBsYXJnZXIgaW4gc2l6ZSB0aGF0IEJpb2NvbmR1Y3RvciBzb2Z0d2FyZSBwYWNha2dlcywgYnV0IGVzc2VudGlhbGx5IHRoZXkgYXJlIGRhdGFiYXNlcyB0aGF0IGNhbiBiZSB1c2VkIHRvIG1ha2UgKm9mZmxpbmUqIHF1ZXJpZXMuIAoKYGBge3J9CmxpYnJhcnkob3JnLk1tLmVnLmRiKQpgYGAKCgpGaXJzdCB3ZSBuZWVkIHRvIGRlY2lkZSB3aGF0IGluZm9ybWF0aW9uIHdlIHdhbnQuIEluIG9yZGVyIHRvIHNlZSB3aGF0IHdlIGNhbiBleHRyYWN0IHdlIGNhbiBydW4gdGhlIGBjb2x1bW5zYCBmdW5jdGlvbiBvbiB0aGUgYW5ub3RhdGlvbiBkYXRhYmFzZS4KCmBgYHtyfQpjb2x1bW5zKG9yZy5NbS5lZy5kYikKYGBgCgpXZSBhcmUgZ29pbmcgdG8gZmlsdGVyIHRoZSBkYXRhYmFzZSBieSBhIGtleSBvciBzZXQgb2Yga2V5cyBpbiBvcmRlciB0byBleHRyYWN0IHRoZSBpbmZvcm1hdGlvbiB3ZSB3YW50LiBWYWxpZCBuYW1lcyBmb3IgdGhlIGtleSBjYW4gYmUgcmV0cmlldmVkIHdpdGggdGhlIGBrZXl0eXBlc2AgZnVuY3Rpb24uCgpgYGB7cn0Ka2V5dHlwZXMob3JnLk1tLmVnLmRiKQpgYGAKCldlIHNob3VsZCBzZWUgYEVOVFJFWklEYCwgd2hpY2ggaXMgdGhlIHR5cGUgb2Yga2V5IHdlIGFyZSBnb2luZyB0byB1c2UgaW4gdGhpcyBjYXNlLiBJZiB3ZSBhcmUgdW5zdXJlIHdoYXQgdmFsdWVzIGFyZSBhY2NlcHRhYmxlIGZvciB0aGUga2V5LCB3ZSBjYW4gY2hlY2sgd2hhdCBrZXlzIGFyZSB2YWxpZCB3aXRoIGBrZXlzYAoKYGBge3J9CmtleXMob3JnLk1tLmVnLmRiLCBrZXl0eXBlPSJFTlRSRVpJRCIpWzE6MTBdCmBgYAoKSXQgaXMgYSB1c2VmdWwgc2FuaXR5IGNoZWNrIHRvIG1ha2Ugc3VyZSB0aGF0IHRoZSBrZXlzIHlvdSB3YW50IHRvIHVzZSBhcmUgYWxsIHZhbGlkLiBXZSBjb3VsZCB1c2UgYCVpbiVgIGluIHRoaXMgY2FzZS4KCmBgYHtyfQojIyBCdWlsZCB1cCB0aGUgcXVlcnkgc3RlcC1ieS1zdGVwCm15LmtleXMgPC0gYygiNTA5MTYiLCAiMTEwMzA4IiwiMTIyOTMiKQpteS5rZXlzICVpbiUga2V5cyhvcmcuTW0uZWcuZGIsIGtleXR5cGU9IkVOVFJFWklEIikKYWxsKG15LmtleXMgJWluJSBrZXlzKG9yZy5NbS5lZy5kYiwga2V5dHlwZT0iRU5UUkVaSUQiKSkKYGBgCgpMZXQncyBidWlsZCB1cCB0aGUgcXVlcnkgc3RlcCBieSBzdGVwLgoKYGBge3IgZXZhbD1GQUxTRX0KIyMgdG8gYmUgZmlsbGVkLWluIGludGVyYWN0aXZlbHkgZHVyaW5nIHRoZSBjbGFzcy4Kc2VsZWN0KG9yZy5NbS5lZy5kYiwKCgpgYGAKCgoKVG8gYW5ub3RhdGUgb3VyIHJlc3VsdHMsIHdlIGRlZmluaXRlbHkgd2FudCBnZW5lIHN5bWJvbHMgYW5kIHBlcmhhcHMgdGhlIGZ1bGwgZ2VuZSBuYW1lLiBMZXQncyBidWlsZCB1cCBvdXIgYW5ub3RhdGlvbiBpbmZvcm1hdGlvbiBpbiBhIHNlcGFyYXRlIGRhdGEgZnJhbWUgdXNpbmcgdGhlIGBzZWxlY3RgIGZ1bmN0aW9uLgoKYGBge3J9CmFubiA8LSBzZWxlY3Qob3JnLk1tLmVnLmRiLGtleXM9cm93bmFtZXMocmVzdWx0cyksY29sdW1ucz1jKCJFTlRSRVpJRCIsIlNZTUJPTCIsIkdFTkVOQU1FIikpCiMgSGF2ZSBhIGxvb2sgYXQgdGhlIGFubm90YXRpb24KYW5uCgpgYGAKCkxldCdzIGRvdWJsZSBjaGVjayB0aGF0IHRoZSBgRU5UUkVaSURgIGNvbHVtbiBtYXRjaGVzIGV4YWN0bHkgdG8gb3VyIGByZXN1bHRzYCByb3duYW1lcy4KCmBgYHtyfQp0YWJsZShhbm4kRU5UUkVaSUQ9PXJvd25hbWVzKHJlc3VsdHMpKQpgYGAKCldlIGNhbiBiaW5kIGluIHRoZSBhbm5vdGF0aW9uIGluZm9ybWF0aW9uIHRvIHRoZSBgcmVzdWx0c2AgZGF0YSBmcmFtZS4gKFBsZWFzZSBub3RlIHRoYXQgaWYgdGhlIGBzZWxlY3RgIGZ1bmN0aW9uIHJldHVybnMgYSAxOm1hbnkgbWFwcGluZyB0aGVuIHlvdSBjYW4ndCBqdXN0IGFwcGVuZCB0aGUgYW5ub3RhdGlvbiB0byB0aGUgZml0IG9iamVjdC4pCgpgYGB7cn0KcmVzdWx0cy5hbm5vdGF0ZWQgPC0gY2JpbmQocmVzdWx0cywgYW5uKQpyZXN1bHRzLmFubm90YXRlZApgYGAKCgpXZSBjYW4gc2F2ZSB0aGUgcmVzdWx0cyB0YWJsZSB1c2luZyB0aGUgYHdyaXRlLmNzdmAgZnVuY3Rpb24sIHdoaWNoIHdyaXRlcyB0aGUgcmVzdWx0cyBvdXQgdG8gYSBjc3YgZmlsZSB0aGF0IHlvdSBjYW4gb3BlbiBpbiBleGNlbC4KCmBgYHtyfQp3cml0ZS5jc3YocmVzdWx0cy5hbm5vdGF0ZWQsZmlsZT0iQi5QcmVnVnNMYWNSZXN1bHRzLmNzdiIscm93Lm5hbWVzPUZBTFNFKQpgYGAKCioqQSBub3RlIGFib3V0IGRlY2lkaW5nIGhvdyBtYW55IGdlbmVzIGFyZSBzaWduaWZpY2FudCoqOiBJbiBvcmRlciB0byBkZWNpZGUgd2hpY2ggZ2VuZXMgYXJlIGRpZmZlcmVudGlhbGx5IGV4cHJlc3NlZCwgd2UgdXN1YWxseSB0YWtlIGEgY3V0LW9mZiBvZiAwLjA1IG9uIHRoZSBhZGp1c3RlZCBwLXZhbHVlLCBOT1QgdGhlIHJhdyBwLXZhbHVlLiBUaGlzIGlzIGJlY2F1c2Ugd2UgYXJlIHRlc3RpbmcgbW9yZSB0aGFuIDE1MDAwIGdlbmVzLCBhbmQgdGhlIGNoYW5jZXMgb2YgZmluZGluZyBkaWZmZXJlbnRpYWxseSBleHByZXNzZWQgZ2VuZXMgaXMgdmVyeSBoaWdoIHdoZW4geW91IGRvIHRoYXQgbWFueSB0ZXN0cy4gSGVuY2Ugd2UgbmVlZCB0byBjb250cm9sIHRoZSBmYWxzZSBkaXNjb3ZlcnkgcmF0ZSwgd2hpY2ggaXMgdGhlIGFkanVzdGVkIHAtdmFsdWUgY29sdW1uIGluIHRoZSByZXN1bHRzIHRhYmxlLiBXaGF0IHRoaXMgbWVhbnMgaXMgdGhhdCBpZiAxMDAgZ2VuZXMgYXJlIHNpZ25pZmljYW50IGF0IGEgNVwlIGZhbHNlIGRpc2NvdmVyeSByYXRlLCB3ZSBhcmUgd2lsbGluZyB0byBhY2NlcHQgdGhhdCA1IHdpbGwgYmUgZmFsc2UgcG9zaXRpdmVzLiBOb3RlIHRoYXQgdGhlIGBkZWNpZGVUZXN0c2AgZnVuY3Rpb24gZGlzcGxheXMgc2lnbmlmaWNhbnQgZ2VuZXMgYXQgNVwlIEZEUi4KCj4gIyMgQ2hhbGxlbmdlIHsuY2hhbGxlbmdlfQo+Cj4gUmUtdmlzaXQgdGhlIGBwbG90U21lYXJgIHBsb3QgZnJvbSBhYm92ZSBhbmQgdXNlIHRoZSBgdGV4dGAgZnVuY3Rpb24gdG8gYWRkIGxhYmVscyBmb3IgdGhlIG5hbWVzIG9mIHRoZSB0b3AgMjAwIG1vc3QgREUgZ2VuZXMKPgoKYGBge3IsZWNobz1GQUxTRSxmaWcuaGVpZ2h0PTUsZmlnLndpZHRoPTEwfQoKcGxvdFNtZWFyKGxydC5CdnNMLCBkZS50YWdzPWRldGFncykKCk4gPC0gMjAwCgp0ZXh0KHJlc3VsdHMuYW5ub3RhdGVkJGxvZ0NQTVsxOk5dLHJlc3VsdHMuYW5ub3RhdGVkJGxvZ0ZDWzE6Tl0sbGFiZWxzID0gcmVzdWx0cy5hbm5vdGF0ZWQkU1lNQk9MWzE6Tl0sY29sPSJibHVlIikKYGBgCgoKQW5vdGhlciBjb21tb24gdmlzdWFsaXNhdGlvbiBpcyB0aGUgWyp2b2xjYW5vIHBsb3QqXShodHRwczovL2VuLndpa2lwZWRpYS5vcmcvd2lraS9Wb2xjYW5vX3Bsb3RfKHN0YXRpc3RpY3MpKSB3aGljaCBkaXNwbGF5IGEgbWVhc3VyZSBvZiBzaWduaWZpY2FuY2Ugb24gdGhlIHktYXhpcyBhbmQgZm9sZC1jaGFuZ2Ugb24gdGhlIHgtYXhpcy4gCgpgYGB7cixmaWcuaGVpZ2h0PTUsZmlnLndpZHRoPTEwfQpzaWduaWYgPC0gLWxvZzEwKHJlc3VsdHMuYW5ub3RhdGVkJEZEUikKcGxvdChyZXN1bHRzLmFubm90YXRlZCRsb2dGQyxzaWduaWYscGNoPTE2KQpwb2ludHMocmVzdWx0cy5hbm5vdGF0ZWRbZGV0YWdzLCJsb2dGQyJdLC1sb2cxMChyZXN1bHRzLmFubm90YXRlZFtkZXRhZ3MsIkZEUiJdKSxwY2g9MTYsY29sPSJyZWQiKQoKYGBgCgoKQmVmb3JlIGZvbGxvd2luZyB1cCBvbiB0aGUgREUgZ2VuZXMgd2l0aCBmdXJ0aGVyIGxhYiB3b3JrLCBhIHJlY29tbWVuZGVkICpzYW5pdHkgY2hlY2sqIGlzIHRvIGhhdmUgYSBsb29rIGF0IHRoZSBleHByZXNzaW9uIGxldmVscyBvZiB0aGUgaW5kaXZpZHVhbCBzYW1wbGVzIGZvciB0aGUgZ2VuZXMgb2YgaW50ZXJlc3QuIFdlIGNhbiBxdWlja2x5IGxvb2sgYXQgZ3JvdXBlZCBleHByZXNzaW9uIHVzaW5nIGBzdHJpcGNoYXJ0YC4gV2UgY2FuIHVzZSB0aGUgbm9ybWFsaXNlZCBsb2cgZXhwcmVzc2lvbiB2YWx1ZXMgaW4gdGhlICBgZGdlQ291bnRzYCBvYmplY3QgKGBkZ2VDb3VudHMkY291bnRzYCkuCgpgYGB7cixmaWcud2lkdGg9MTIsZmlnLmhlaWdodD01fQpsaWJyYXJ5KFJDb2xvckJyZXdlcikKcGFyKG1mcm93PWMoMSwzKSkKbm9ybUNvdW50cyA8LSBkZ2VPYmokY291bnRzCiMgTGV0J3MgbG9vayBhdCB0aGUgZmlyc3QgZ2VuZSBpbiB0aGUgdG9wVGFibGUsIElyeDQsIHdoaWNoIGhhcyBhIHJvd25hbWUgNTA5MTYKc3RyaXBjaGFydChub3JtQ291bnRzWyI1MDkxNiIsXX5ncm91cCkKIyBUaGlzIHBsb3QgaXMgdWdseSwgbGV0J3MgbWFrZSBpdCBiZXR0ZXIKc3RyaXBjaGFydChub3JtQ291bnRzWyI1MDkxNiIsXX5ncm91cCx2ZXJ0aWNhbD1UUlVFLGxhcz0yLGNleC5heGlzPTAuOCxwY2g9MTYsY29sPTE6NixtZXRob2Q9ImppdHRlciIpCiMgTGV0J3MgdXNlIG5pY2VyIGNvbG91cnMKbmljZS5jb2wgPC0gYnJld2VyLnBhbCg2LG5hbWU9IkRhcmsyIikKc3RyaXBjaGFydChub3JtQ291bnRzWyI1MDkxNiIsXX5ncm91cCx2ZXJ0aWNhbD1UUlVFLGxhcz0yLGNleC5heGlzPTAuOCxwY2g9MTYsY2V4PTEuMyxjb2w9bmljZS5jb2wsbWV0aG9kPSJqaXR0ZXIiLHlsYWI9Ik5vcm1hbGlzZWQgbG9nMiBleHByZXNzaW9uIixtYWluPSIJSXJ4NCIpCmBgYAoKQW4gaW50ZXJhY3RpdmUgdmVyc2lvbiBvZiB0aGUgdm9sY2FubyBwbG90IGFib3ZlIHRoYXQgaW5jbHVkZXMgdGhlIHJhdyBwZXIgc2FtcGxlIHZhbHVlcyBpbiBhIHNlcGFyYXRlIHBhbmVsIGlzIHBvc3NpYmxlIHZpYSB0aGUgYGdsWFlQbG90YCBmdW5jdGlvbiBpbiB0aGUgKkdsaW1tYSogcGFja2FnZS4KCgpgYGB7cn0KbGlicmFyeShHbGltbWEpCmdyb3VwMiA8LSBncm91cApsZXZlbHMoZ3JvdXAyKSA8LSBjKCJiYXNhbC5sYWN0YXRlIiwiYmFzYWwucHJlZyIsImJhc2FsLnZpcmdpbiIsImx1bS5sYWN0YXRlIiwgImx1bS5wcmVnIiwgImx1bS52aXJnaW4iKQpnbFhZUGxvdCh4PXJlc3VsdHMkbG9nRkMsIHk9LWxvZzEwKHJlc3VsdHMkRkRSKSwKICAgICAgICAgeGxhYj0ibG9nRkMiLCB5bGFiPSJCIiwgbWFpbj0iQi5QcmVnVnNMYWMiLAogICAgICAgICBjb3VudHM9bm9ybUNvdW50cywgZ3JvdXBzPWdyb3VwMiwgc3RhdHVzPWRlLAogICAgICAgICBhbm5vPWFubiwgaWQuY29sdW1uPSJFTlRSRVpJRCIsIGZvbGRlcj0idm9sY2FubyIpCmBgYAoKClRoaXMgZnVuY3Rpb24gY3JlYXRlcyBhbiBodG1sIHBhZ2UgKC4vdm9sY2Fuby9YWS1QbG90Lmh0bWwpIHdpdGggYSB2b2xjYW5vIHBsb3Qgb24gdGhlIGxlZnQgYW5kIGEgcGxvdCBzaG93aW5nIHRoZSBsb2ctQ1BNIHBlciBzYW1wbGUgZm9yIGEgc2VsZWN0ZWQgZ2VuZSBvbiB0aGUgcmlnaHQuIEEgc2VhcmNoIGJhciBpcyBhdmFpbGFibGUgdG8gc2VhcmNoIGZvciBnZW5lcyBvZiBpbnRlcmVzdC4KCgoKIyMgUmV0cmlldmluZyBHZW5vbWljIExvY2F0aW9ucwoKCkl0IG1pZ2h0IHNlZW0gbmF0dXJhbCB0byBhZGQgZ2Vub21pYyBsb2NhdGlvbnMgdG8gb3VyIGFubm90YXRpb24gdGFibGUsIGFuZCBwb3NzaWJseSBhIGJpdCBvZGQgdGhhdCB0aGUgYG9yZy5NbS5lZy5kYmAgcGFja2FnZSBkb2VzIG5vdCBzdXBwbHkgc3VjaCBtYXBwaW5ncy4gSW4gZmFjdCwgdGhlcmUgaXMgYSB3aG9sZSBzdWl0ZSBvZiBwYWNrYWdlIGZvciBwZXJmb3JtaW5nIHRoaXMsIGFuZCBtb3JlLWFkdmFuY2VkIHF1ZXJpZXMuIFRoZXNlIGFyZSBsaXN0ZWQgb24gdGhlIEJpb2NvbmR1Y3RvciBbYW5ub3RhdGlvbiBwYWdlXShodHRwOi8vYmlvY29uZHVjdG9yLm9yZy9wYWNrYWdlcy9yZWxlYXNlL0Jpb2NWaWV3cy5odG1sI19fX0Fubm90YXRpb25EYXRhKSBhbmQgaGF2ZSB0aGUgcHJlZml4IGBUeERiLmAKClRoZSBwYWNrYWdlIHdlIHdpbGwgYmUgdXNpbmcgaXMgYFR4RGIuTW11c2N1bHVzLlVDU0MubW0xMC5rbm93bkdlbmVgLiBQYWNrYWdlcyBhcmUgYXZhaWxhYmxlIGZvciBvdGhlciBvcmdhbmlzbXMgYW5kIGdlbm9tZSBidWlsZHMuIEl0IGlzIGV2ZW4gcG9zc2libGUgdG8gKmJ1aWxkIHlvdXIgb3duIGRhdGFiYXNlKiBpZiBvbmUgZG9lcyBub3QgZXhpc3QuIFNlZSBgdmlnbmV0dGUoIkdlbm9taWNGZWF0dXJlcyIpYCBmb3IgZGV0YWlscwoKYGBge3IgZXZhbD1GQUxTRX0Kc291cmNlKCJodHRwOi8vd3d3LmJpb2NvbmR1Y3Rvci5vcmcvYmlvY0xpdGUuUiIpCmJpb2NMaXRlKCJUeERiLk1tdXNjdWx1cy5VQ1NDLm1tMTAua25vd25HZW5lIikKCiMjIEZvciBIdW1hbnMKYmlvY0xpdGUoIlR4RGIuSHNhcGllbnMuVUNTQy5oZzE5Lmtub3duR2VuZSIpCgpgYGAKCldlIGxvYWQgdGhlIGxpYnJhcnkgaW4gdGhlIHVzdWFsIGZhc2hpb24gYW5kIGNyZWF0ZSBhIG5ldyBvYmplY3QgdG8gc2F2ZSBzb21lIHR5cGluZy4gQXMgd2l0aCB0aGUgYG9yZy5gIHBhY2thZ2VzLCB3ZSBjYW4gcXVlcnkgd2hhdCBjb2x1bW5zIGFyZSBhdmFpbGFibGUgd2l0aCBgY29sdW1uc2AsCgpgYGB7cn0KbGlicmFyeShUeERiLk1tdXNjdWx1cy5VQ1NDLm1tMTAua25vd25HZW5lKQp0eCA8LSBUeERiLk1tdXNjdWx1cy5VQ1NDLm1tMTAua25vd25HZW5lCmNvbHVtbnModHgpCmBgYAoKVGhlIGBzZWxlY3RgIGZ1bmN0aW9uIGlzIHVzZWQgaW4gdGhlIHNhbWUgbWFubmVyIGFzIHRoZSBgb3JnLk1tLmVnLmRiYCBwYWNrYWdlcy4gCgoKPiAjIyBDaGFsbGVuZ2Ugey5jaGFsbGVuZ2V9Cj4KPiBVc2UgdGhlIFR4RGIuTW11c2N1bHVzLlVDU0MubW0xMC5rbm93bkdlbmUgcGFja2FnZSB0byByZXRyaWV2ZSB0aGUgZXhvbiBjb29yZGluYXRlcyBmb3IgdGhlIGdlbmVzIGA1MDkxNmAsIGAxMTAzMDhgLCBgMTIyOTNgCj4KCmBgYHtyIGVjaG89RkFMU0Usd2FybmluZz1GQUxTRSxtZXNzYWdlPUZBTFNFfQprZXlzIDwtIGMoIjUwOTE2IiwiMTEwMzA4IiwiMTIyOTMiKQpzZWxlY3QodHgsIGtleXM9a2V5cywKICAgICAgIGtleXR5cGUgPSAiR0VORUlEIiwKICAgICAgIGNvbHVtbnM9YygiRVhPTkNIUk9NIiwiRVhPTlNUQVJUIiwiRVhPTkVORCIpCiAgICAgICkKCmBgYAoKIyMjIE92ZXJ2aWV3IG9mIEdlbm9taWNSYW5nZXMKCk9uZSBvZiB0aGUgcmVhbCBzdHJlbmd0aHMgb2YgdGhlIGB0eGRiLi5gIHBhY2thZ2VzIGlzIHRoZSBhYmlsaXR5IG9mIGludGVyZmFjZSB3aXRoIGBHZW5vbWljUmFuZ2VzYCwgd2hpY2ggaXMgdGhlIG9iamVjdCB0eXBlIHVzZWQgdGhyb3VnaG91dCBCaW9jb25kdWN0b3IgW3RvIG1hbmlwdWxhdGUgR2Vub21pYyBJbnRlcnZhbHNdKGh0dHBzOi8vd3d3Lm5jYmkubmxtLm5paC5nb3YvcG1jL2FydGljbGVzL1BNQzM3Mzg0NTgvcGRmL3BjYmkuMTAwMzExOC5wZGYpLiAKClRoZXNlIG9iamVjdCB0eXBlcyBwZXJtaXQgdXMgdG8gcGVyZm9ybSBjb21tb24gb3BlcmF0aW9ucyBvbiBpbnRlcnZhbHMgc3VjaCBhcyBvdmVybGFwcGluZyBhbmQgY291bnRpbmcuCmBgYHtyfQpsaWJyYXJ5KEdlbm9taWNSYW5nZXMpCm15LnJhbmdlIDwtR1JhbmdlcygiY2hyMSIsIElSYW5nZXMoc3RhcnQ9MTAwMCxlbmQ9MjAwMCkpCm15LnJhbmdlCgpgYGAKCkxldCdzIHRyeSBzb21lIGR1bW15IGludGVydmFscyB3aXRoIHJhbmRvbSBjaHJvbXNvbWUgYXNzaWdubWVudHMgYW5kIHN0YXJ0IHBvc2l0aW9ucy4gCmBgYHtyfQpzZXQuc2VlZCgwNTA1MjAxNykKY2hycyA8LSBzYW1wbGUocGFzdGUwKCJjaHIiLDE6MTkpLDEwMCxyZXBsYWNlPVRSVUUpCnN0YXJ0UG9zIDwtIHNhbXBsZSgxOjVlNiwxMDAscmVwbGFjZT1UUlVFKQpteS5yYW5nZXNBIDwtIEdSYW5nZXMoY2hycywgSVJhbmdlcyhzdGFydD1zdGFydFBvcyx3aWR0aD0xMDAwKSkKbXkucmFuZ2VzQQoKYGBgCgpUaGVyZSBhcmUgYSBudW1iZXIgb2YgdXNlZnVsIGZ1bmN0aW9ucyBmb3IgY2FsY3VsYXRpbmcgcHJvcGVydGllcyBvZiB0aGUgZGF0YSAoc3VjaCBhcyAqY292ZXJhZ2UqIG9yIHNvcnRpbmcpLiBJdCBpcyBldmVuIHBvc3NpYmxlIHRvIGNvbnZlcnQgYmV0d2VlbiBkaWZmZXJlbnQgY2hyb21vc29tZSBuYW1pbmcgY29udmVudGlvbnMuCgpgYGB7cn0Kd2lkdGgobXkucmFuZ2VzQSkKc29ydChteS5yYW5nZXNBKQpjb3ZlcmFnZShteS5yYW5nZXNBKQpzZXFsZXZlbHNTdHlsZShteS5yYW5nZXNBKQprZWVwU2VxbGV2ZWxzKG15LnJhbmdlc0EsImNocjE5IikKI3NlcWxldmVsc1N0eWxlKG15LnJhbmdlc0EpIDwtICJFbnNlbWJsIgojbXkucmFuZ2VzQQpgYGAKCgpgYGB7cn0KbXkucmFuZ2VzQiA8LSBzaGlmdChteS5yYW5nZXNBLCBzaGlmdCA9IDUwMCkKbXkucmFuZ2VzQiA8LSByZXNpemUobXkucmFuZ2VzQix3aWR0aCA9c2FtcGxlKDE6MTAwMCwxMDAscmVwbGFjZSA9IFRSVUUpKQpteS5yYW5nZXNCCmBgYAoKYGBge3J9CmZpbmRPdmVybGFwcyhteS5yYW5nZXNBLG15LnJhbmdlc0IpCmBgYAoKIyMgUmV0cmlldmluZyBHZW5lIENvb3JkaW5hdGVzIGFzIEdlbm9taWNSYW5nZXMKCkl0IGlzIHF1aXRlIHN0cmFpZ2h0Zm9yd2FyZCB0byB0cmFuc2xhdGUgdGhlIG91dHB1dCBvZiBhIGBzZWxlY3RgIHF1ZXJ5IGludG8gYSBgR2Vub21pY0ZlYXR1cmVzYCBvYmplY3QuIEhvd2V2ZXIsIHNldmVyYWwgY29udmVuaWVuY2UgZnVuY3Rpb25zIGV4aXN0IHRvIHJldHJpZXZlIHRoZSBzdHJ1Y3R1cmUgb2YgZXZlcnkgZ2VuZSBmb3IgYSBnaXZlbiBvcmdhbmlzbSBpbiBvbmUgb2JqZWN0LiAKClRoZSBvdXRwdXQgb2YgYGV4b25zQnlgIGlzIGEgbGlzdCwgd2hlcmUgZWFjaCBpdGVtIGluIHRoZSBsaXN0IGlzIHRoZSBleG9uIGNvLW9yZGluYXRlcyBvZiBhIHBhcnRpY3VsYXIgZ2VuZS4gCgpgYGB7cn0KZXhvIDwtIGV4b25zQnkodHgsImdlbmUiKQpleG8KYGBgCgpUbyBhY2Nlc3MgdGhlIHN0cnVjdHVyZSBvZiBhIHBhcnRpY3VsYXIgZ2VuZSwgd2UgY2FuIHVzZSB0aGUgYFtbYCBzeW50YXggd2l0aCB0aGUgbmFtZSBvZiB0aGUgZ2VuZSAoRW50cmV6IGdlbmUgSUQpIHdpdGhpbiBxdW90ZSBtYXJrcy4KCmBgYHtyfQpleG9bWyIxMjk5MiJdXQpgYGAKCgojIyBFeHBvcnRpbmcgdHJhY2tzCgpJdCBpcyBhbHNvIHBvc3NpYmxlIHRvIHNhdmUgdGhlIHJlc3VsdHMgb2YgYSBCaW9jb25kdWN0b3IgYW5hbHlzaXMgaW4gYSBicm93c2VyIHRvIGVuYWJsZSBpbnRlcmFjdGl2ZSBhbmFseXNpcyBhbmQgaW50ZWdyYXRpb24gd2l0aCBvdGhlciBkYXRhIHR5cGVzLCBvciBzaGFyaW5nIHdpdGggY29sbGFib3JhdG9ycy4gRm9yIGluc3RhbmNlLCB3ZSBtaWdodCB3YW50IGEgYnJvd3NlciB0cmFjayB0byBpbmRpY2F0ZSB3aGVyZSBvdXIgZGlmZmVyZW50aWFsbHktZXhwcmVzc2VkIGdlbmVzIGFyZSBsb2NhdGVkLiBXZSBzaGFsbCB1c2UgdGhlIGBiZWRgIGZvcm1hdCB0byBkaXNwbGF5IHRoZXNlIGxvY2F0aW9ucy4gV2Ugd2lsbCBhbm5vdGF0ZSB0aGUgcmFuZ2VzIHdpdGggaW5mb3JtYXRpb24gZnJvbSBvdXIgYW5hbHlzaXMgc3VjaCBhcyB0aGUgZm9sZC1jaGFuZ2UgYW5kIHNpZ25pZmljYW5jZS4KCkZpcnN0IHdlIGNyZWF0ZSBhIGRhdGEgZnJhbWUgZm9yIGp1c3QgdGhlIERFIGdlbmVzLgpgYGB7cn0Kc2lnR2VuZXMgPC0gcmVzdWx0cy5hbm5vdGF0ZWRbZGV0YWdzLF0Kc2lnR2VuZXMKYGBgCgpBdCB0aGUgbW9tZW50LCB3ZSBoYXZlIGEgR2Vub21pY0ZlYXR1cmVzIG9iamVjdCB0aGF0IHJlcHJlc2VudHMgZXZlcnkgZXhvbi4gSG93ZXZlciwgd2UgZG8gbm90Cm5lZWQgdGhpcyBsZXZlbCBvZiBncmFudWxhcml0eSBmb3IgdGhlIGJlZCBvdXRwdXQsIHNvIHdlIHdpbGwgY29sbGFwc2UgdG8gYSBzaW5nbGUgcmVnaW9uIGZvciBlYWNoIGdlbmUuIEZpcnN0IHdlIHRoZSBgcmFuZ2VgIGZ1bmN0aW9uIHRvIG9idGFpbiBhIHNpbmdsZSByYW5nZSBmb3IgZXZlcnkgZ2VuZSBhbmQgdHJhbmZvcm0gdG8gYSBtb3JlIGNvbnZlbmllbnQgb2JqZWN0IHdpdGggYHVubGlzdGAuCmBgYHtyfQpyYW5nZShleG8pCmV4b1JhbmdlcyA8LSB1bmxpc3QocmFuZ2UoZXhvKSkKc2lnUmVnaW9ucyA8LSBleG9SYW5nZXNbbmEub21pdChtYXRjaChzaWdHZW5lcyRFTlRSRVpJRCwgbmFtZXMoZXhvUmFuZ2VzKSkpXQpzaWdSZWdpb25zCmBgYAoKUmF0aGVyIHRoYW4ganVzdCByZXByZXNlbnRpbmcgdGhlIGdlbm9taWMgbG9jYXRpb25zLCB0aGUgLmJlZCBmb3JtYXQgaXMgYWxzbyBhYmxlIHRvIGNvbG91ciBlYWNoIHJhbmdlCmFjY29yZGluZyB0byBzb21lIHByb3BlcnR5IG9mIHRoZSBhbmFseXNpcyAoZS5nLiBkaXJlY3Rpb24gYW5kIG1hZ25pdHVkZSBvZiBjaGFuZ2UpIHRvIGhlbHAgaGlnaGxpZ2h0CnBhcnRpY3VsYXIgcmVnaW9ucyBvZiBpbnRlcmVzdC4gQSBzY29yZSBjYW4gYWxzbyBiZSBkaXNwbGF5ZWQgd2hlbiBhIHBhcnRpY3VsYXIgcmVnaW9uIGlzIGNsaWNrZWQtb24uCkEgdXNlZnVsIHByb3Blcnkgb2YgR2Vub21pY1JhbmdlcyBpcyB0aGF0IHdlIGNhbiBhdHRhY2ggKm1ldGFkYXRhKiB0byBlYWNoIHJhbmdlIHVzaW5nIHRoZSBgbWNvbHNgCmZ1bmN0aW9uLiBUaGUgbWV0YWRhdGEgY2FuIGJlIHN1cHBsaWVkIGluIHRoZSBmb3JtIG9mIGEgZGF0YSBmcmFtZS4KCmBgYHtyfQpzaWdSZWdpb25zCm1jb2xzKHNpZ1JlZ2lvbnMpIDwtIHNpZ0dlbmVzW21hdGNoKG5hbWVzKHNpZ1JlZ2lvbnMpLCByb3duYW1lcyhzaWdHZW5lcykpLF0Kc2lnUmVnaW9ucwpgYGAKClRoZSBtZXRhZGF0YSB3ZSBoYXZlIGFkZGVkIGNhbiBhbHNvIGJ5IHVzZWQgYXMgYSBtZWFucyB0byBpbnRlcnJvZ2F0ZSB0aGUgcmFuZ2VzOyBhcyBpZiB0aGUgZGF0YSB3ZXJlIGNvbnRhaW5lZCBpbiBhIGRhdGEgZnJhbWUuCgpgYGB7cn0Kc2lnUmVnaW9uc1tvcmRlcihzaWdSZWdpb25zJExSLGRlY3JlYXNpbmcgPSBUUlVFKV0KYGBgCgpGb3IgdmlzdWFsaXNhdGlvbiBwdXJwb3Nlcywgd2UgYXJlIGdvaW5nIHRvIHJlc3RyaWN0IHRoZSBkYXRhIHRvIGdlbmVzIHRoYXQgYXJlIGxvY2F0ZWQgb24gY2hyb21vc29tZXMgMSB0byAxOSBhbmQgdGhlIHNleCBjaHJvbW9zb21lcy4gVGhpcyBjYW4gYmUgZG9uZSB3aXRoIHRoZSBga2VlcFNlcUxldmVsc2AgZnVuY3Rpb24uCgpgYGB7cn0Kc2VxbGV2ZWxzKHNpZ1JlZ2lvbnMpCnNpZ1JlZ2lvbnMgPC0ga2VlcFNlcWxldmVscyhzaWdSZWdpb25zLCBwYXN0ZTAoImNociIsIGMoMToxOSwiWCIsIlkiKSkpCmBgYAoKV2Ugd2lsbCBub3cgY3JlYXRlIGEgc2NvcmUgZnJvbSB0aGUgcC12YWx1ZXMgdGhhdCB3aWxsIGRpc3BsYXllZCB1bmRlciBlYWNoIHJlZ2lvbiwgYW5kIGNvbG91ciBzY2hlbWUKZm9yIHRoZSByZWdpb25zIGJhc2VkIG9uIHRoZSBmb2xkLWNoYW5nZS4gRm9yIHRoZSBzY29yZSB3ZSBjYW4gdXNlIHRoZSAkLWxvZ197MTB9JCBvZiB0aGUgYWRqdXN0ZWQgcC12YWx1ZSBhcyBiZWZvcmUKCgoKYGBge3J9ClNjb3JlIDwtIC1sb2cxMChzaWdSZWdpb25zJEZEUikKYGBgCgpgY29sb3JSYW1wUGFsZXR0ZWAgaXMgYSB1c2VmdWwgZnVuY3Rpb24gaW4gYmFzZSBSIGZvciBjb25zdHJ1Y3RpbmcgYSBwYWxldHRlIGJldHdlZW4gdHdvIGV4dHJlbWVzLiAqKldoZW4gY2hvb3NpbmcgY29sb3VyIHBhbGV0dGVzLCBtYWtlIHN1cmUgdGhleSBhcmUgY29sb3VyIGJsaW5kIGZyaWVuZGx5KiouIFRoZSByZWQgLyBncmVlbiBjb2xvdXIgc2NoZW1lIHRyYWRpdGlvbmFsbHktYXBwbGllZCB0byBtaWNyb2FycmF5cyBpcyBhICoqKmJhZCoqKiBjaG9pY2UuCgpXZSB3aWxsIGFsc28gdHJ1bmNhdGUgdGhlIGZvbGQtY2hhbmdlcyB0byBiZXR3ZWVuIC01IGFuZCA1IHRvIGFuZCBkaXZpZGUgdGhpcyByYW5nZSBpbnRvIDEwIGVxdWFsIGJpbnMKCmBgYHtyfQpyYlBhbCA8LWNvbG9yUmFtcFBhbGV0dGUoYygicmVkIiwgImJsdWUiKSkKbG9nZmMgPC0gcG1heChzaWdSZWdpb25zJGxvZ0ZDLCAtNSkKbG9nZmMgPC0gcG1pbihsb2dmYyAsIDUpCgpDb2wgPC0gcmJQYWwoMTApW2FzLm51bWVyaWMoY3V0KGxvZ2ZjLCBicmVha3MgPSAxMCkpXQpgYGAKClRoZSBjb2xvdXJzIGFuZCBzY29yZSBoYXZlIHRvIGJlIHNhdmVkIGluIHRoZSBHUmFuZ2VzIG9iamVjdCBhcyBgc2NvcmVgIGFuZCBgaXRlbVJnYmAgY29sdW1ucyByZXNwZWN0aXZlbHksIGFuZCB3aWxsIGJlIHVzZWQgdG8gY29uc3RydWN0IHRoZSBicm93c2VyIHRyYWNrLiBUaGUgcnRyYWNrbGF5ZXIgcGFja2FnZSBjYW4gYmUgdXNlZCB0byBpbXBvcnQgYW5kIGV4cG9ydCBicm93c2VycyB0cmFja3MuCgpOb3cgd2UgY2FuIGV4cG9ydCB0aGUgc2lnbmlmY2FudCByZXN1bHRzIGZyb20gdGhlIERFIGFuYWx5c2lzIGFzIGEgYC5iZWRgIHRyYWNrIHVzaW5nIGBydHJhY2tsYXllcmAuIFlvdSBjYW4gbG9hZCB0aGUgcmVzdWx0aW5nIGZpbGUgaW4gSUdWLCBpZiB5b3Ugd2lzaC4KYGBge3J9Cm1jb2xzKHNpZ1JlZ2lvbnMpJHNjb3JlIDwtIFNjb3JlCm1jb2xzKHNpZ1JlZ2lvbnMpJGl0ZW1SZ2IgPC0gQ29sCnNpZ1JlZ2lvbnMKbGlicmFyeShydHJhY2tsYXllcikKZXhwb3J0KHNpZ1JlZ2lvbnMgLCBjb24gPSAidG9wSGl0cy5iZWQiKQpgYGAKCiMjIEV4dHJhY3RpbmcgUmVhZHMKCkFzIHdlIGhhdmUgYmVlbiB1c2luZyBjb3VudHMgYXMgb3VyIHN0YXJ0aW5nIHBvaW50LCB3ZSBoYXZlbid0IGludmVzdGlnYXRlZCB0aGUgYWxpZ25lZCByZWFkcyBmcm9tIG91ciBleHBlcmltZW50LCBhbmQgaG93IHRoZXkgYXJlIHJlcHJlc2VudGVkLiBBcyB5b3UgbWF5IGJlIGF3YXJlLCBhbGlnbmVkIHJlYWRzIGFyZSB1c3VhbGx5IHN0b3JlZCBpbiBhICpiYW0qIGZpbGUgdGhhdCBjYW4gYmUgbWFuaXB1bGF0ZWQgd2l0aCBvcGVuLXNvdXJjZSBjb21tYW5kLWxpbmUgdG9vbHMgc3VjaCBhcyBbKnNhbXRvb2xzKl0oaHR0cDovL3d3dy5odHNsaWIub3JnLykgYW5kIFsqcGljYXJkKl0oaHR0cHM6Ly9icm9hZGluc3RpdHV0ZS5naXRodWIuaW8vcGljYXJkLykuIEJpb2NvbmR1Y3RvciBwcm92aWRlIGEgbG93LWxldmVsIGludGVyZmFjZSB0byBiYW0vc2FtIGZpbGVzIGluIHRoZSBmb3JtIG9mIHRoZSBgUnNhbXRvb2xzYCBwYWNrYWdlLiBUaGUgYEdlbm9taWNBbGlnbm1lbnRzYCBwYWNrYWdlIGNhbiBhbHNvIGJlIHVzZWQgdG8gcmV0cmlldmUgdGhlIHJlYWRzIG1hcHBpbmcgdG8gYSBwYXJ0aWN1bGFyIGdlbm9taWMgcmVnaW9uIGluIGFuIGVmZmljaWVudCBtYW5uZXIuCgpgYGB7cn0KbGlicmFyeShHZW5vbWljQWxpZ25tZW50cykKYGBgCgpgYGB7ciBldmFsPUZBTFNFfQpnZW5lcmVnaW9uIDwtIGV4b1tbIjUwOTE2Il1dCmdldHdkKCkKYmFtIDwtIHJlYWRHQWxpZ25tZW50cyhmaWxlPSJiYW0vTUNMMS5ERy5iYW0iLAogICAgICAgICAgICAgICAgICAgICAgIHBhcmFtPVNjYW5CYW1QYXJhbSh3aGljaD1nZW5lcmVnaW9uKSkKYmFtCmBgYAoKVGhlcmUgYXJlIHZhcmlvdXMgdmlzdWFsaXNhdGlvbiBvcHRpb25zIGZvciBhbGlnbmVkIHJlYWRzIGFuZCByYW5nZSBkYXRhLiBXZSB3aWxsIHVzZSB0aGUgYGdnYmlvYCBwYWNrYWdlLCB3aGljaCBmaXJzdCByZXF1aXJlcyBzb21lIGRpc2N1c3Npb24gb2YgdGhlIGBnZ3Bsb3QyYCBwbG90dGluZyBwYWNrYWdlLgoKCiMjIEJyaWVmIEludHJvZHVjdGlvbiB0byBnZ3Bsb3QyCgpUaGUgW2BnZ3Bsb3QyYF0oaHR0cDovL2dncGxvdDIudGlkeXZlcnNlLm9yZy8pIHBhY2thZ2UgaGFzIGVtZXJnZWQgYXMgYW4gYXR0cmFjdGl2ZSBhbHRlcm5hdGl2ZSB0byB0aGUgdHJhZGl0aW9uYWwgcGxvdHMgcHJvdmlkZWQgYnkgYmFzZSBSLiBBIGZ1bGwgb3ZlcnZpZXcgb2YgYWxsIGNhcGFiaWxpdGllcyBvZiB0aGUgcGFja2FnZSBpcyBhdmFpbGFibGUgZnJvbSB0aGUgW2NoZWF0c2hlZXRdKGh0dHBzOi8vd3d3LnJzdHVkaW8uY29tL3dwLWNvbnRlbnQvdXBsb2Fkcy8yMDE1LzAzL2dncGxvdDItY2hlYXRzaGVldC5wZGYpLgoKQSBzaW1wbGUgc2NhdHRlciBwbG90LCBlcXVpdmFsZW50IHRvIGBwbG90U21lYXJgIGZyb20gYmVmb3JlLCBjYW4gYmUgZ2VuZXJhdGVkIGFzIGZvbGxvd3M6LQoKYGBge3J9CmxpYnJhcnkoZ2dwbG90MikKZ2dwbG90KHJlc3VsdHMsIGFlcyh4ID0gbG9nQ1BNLCB5PWxvZ0ZDKSkgKyBnZW9tX3BvaW50KCkgCgpgYGAKCkluIGJyaWVmOi0KCi0gYHJlc3VsdHNgIGlzIG91ciBkYXRhIGZyYW1lIGNvbnRhaW5pbmcgdGhlIHZhcmlhYmxlcyB3ZSB3aXNoIHRvIHBsb3QKLSBgYWVzYCBjcmVhdGVzIGEgbXBwaW5nIGJldHdlZW4gdGhlIHZhcmlhYmxlcyBpbiBvdXIgZGF0YSBmcmFtZSB0byB0aGUgKmFlcyp0aGV0aWMgcHJvcHJ0aWVzIG9mIHRoZSBwbG90CiAgICArIHRoZSB4LWF4aXMgaXMgbWFwcGVkIHRvIGBsb2dDUE1gLCB5LWF4aXMgaXMgbWFwcGVkIHRvIGBsb2dGQ2AKLSBgZ2VvbV9wb2ludGAgc3BlY2lmaWVzIHRoZSBwYXJ0aWN1bGFyIHR5cGUgb2YgcGxvdCB3ZSB3YW50IChpbiB0aGlzIGNhc2UgYSBzY2F0dGVyIHBsb3QpCiAgICArIHNlZSBbdGhlIGNoZWF0c2hlZXRdKGh0dHBzOi8vd3d3LnJzdHVkaW8uY29tL3dwLWNvbnRlbnQvdXBsb2Fkcy8yMDE1LzAzL2dncGxvdDItY2hlYXRzaGVldC5wZGYpIGZvciBvdGhlciBwbG90IHR5cGVzCgpUaGUgcmVhbCBhZHZhbnRhZ2Ugb2YgYGdncGxvdDJgIGlzIHRoZSBhYmlsaXR5IHRvIGNoYW5nZSB0aGUgYXBwZWFyYW5jZSBvZiBvdXIgcGxvdCBieSBtYXBwaW5nIG90aGVyIHZhcmlhYmxlcyB0byBhc3BlY3RzIG9mIHRoZSBwbG90LiBGb3IgZXhhbXBsZSwgd2UgY291bGQgY29sb3VyIHRoZSBwb2ludHMgYmFzZWQgb24gYSBwLXZhbHVlIGN1dC1vZmYuIFRoZSBjb2xvdXJzIGFyZSBhdXRvbWF0aWNhbGx5IGNob3NlbiBieSBgZ2dwbG90MmAsIGJ1dCB3ZSBjYW4gc3BlY2lmaXkgcGFydGljdWxhciB2YWx1ZXMuCgpgYGB7cn0KZ2dwbG90KHJlc3VsdHMsIGFlcyh4ID0gbG9nQ1BNLCB5PWxvZ0ZDLGNvbD1GRFIgPCAwLjA1KSkgKyBnZW9tX3BvaW50KCkKCmdncGxvdChyZXN1bHRzLCBhZXMoeCA9IGxvZ0NQTSwgeT1sb2dGQyxjb2w9RkRSIDwgMC4wNSkpICsgZ2VvbV9wb2ludChhbHBoYT0wLjQpICsgc2NhbGVfY29sb3VyX21hbnVhbCh2YWx1ZXM9YygiYmxhY2siLCJyZWQiKSkKYGBgCgpgYGB7cn0KZ2dwbG90KHJlc3VsdHMsIGFlcyh4ID0gbG9nQ1BNLCB5PWxvZ0ZDLGNvbD1GRFIgPCAwLjA1KSkgKyBnZW9tX3BvaW50KCkgKyBzY2FsZV9jb2xvdXJfbWFudWFsKHZhbHVlcz1jKCJibGFjayIsInJlZCIpKQpgYGAKClRoZSB2b2xjYW5vIHBsb3QgY2FuIGJlIGNvbnN0cnVjdGVkIGluIGEgc2ltaWxhciBtYW5uZXIKCmBgYHtyfQpnZ3Bsb3QocmVzdWx0cywgYWVzKHggPSBsb2dGQywgeT0tbG9nMTAoRkRSKSkpICsgZ2VvbV9wb2ludCgpCmBgYAoKCiMjIENvbXBvc2luZyBwbG90cyB3aXRoIGdnYmlvCgpXZSB3aWxsIG5vdyB0YWtlIGEgYnJpZWYgbG9vayBhdCBvbmUgb2YgdGhlIHZpc3VhbGlzYXRpb24gcGFja2FnZXMgaW4gQmlvY29uZHVjdG9yIHRoYXQgdGFrZXMgYWR2YW50YWdlCm9mIHRoZSBHZW5vbWljUmFuZ2VzIGFuZCBHZW5vbWljRmVhdHVyZXMgb2JqZWN0LXR5cGVzLiBJbiB0aGlzIHNlY3Rpb24gd2Ugd2lsbCBzaG93IGEgd29ya2VkCmV4YW1wbGUgb2YgaG93IHRvIGNvbWJpbmUgc2V2ZXJhbCB0eXBlcyBvZiBnZW5vbWljIGRhdGEgb24gdGhlIHNhbWUgcGxvdC4gVGhlIGRvY3VtZW50YXRpb24gZm9yCmdnYmlvIGlzIHZlcnkgZXh0ZW5zaXZlIGFuZCBjb250YWlucyBsb3RzIG9mIGV4YW1wbGVzLgoKaHR0cDovL3d3dy50ZW5nZmVpLm5hbWUvZ2diaW8vZG9jcy8KClRoZSBgR3ZpemAgcGFja2FnZSBpcyBhbm90aGVyIEJpb2NvbmR1Y3RvciBwYWNrYWdlIHRoYXQgc3BlY2lhbGlzaW5nIGluIGdlbm9taWMgdmlzdWFsaXNhdGlvbnMsIGJ1dCB3ZQp3aWxsIG5vdCBleHBsb3JlIHRoaXMgcGFja2FnZSBpbiB0aGUgY291cnNlLgoKVGhlIE1hbmhhdHRhbiBwbG90IGlzIGEgY29tbW9uIHdheSBvZiB2aXN1YWxpc2luZyBnZW5vbWUtd2lkZSByZXN1bHRzLCBhbmQgdGhpcyBpcyBpbXBsZW1lbnRlZCBhcyB0aGUKYHBsb3RHcmFuZExpbmVhcmAgZnVuY3Rpb24uIFdlIGhhdmUgdG8gc3VwcGx5IGEgdmFsdWUgdG8gZGlzcGxheSBvbiB0aGUgeS1heGlzIHVzaW5nIHRoZSBgYWVzYCBmdW5jdGlvbiwKd2hpY2ggaXMgaW5oZXJpdGVkIGZyb20gZ2dwbG90Mi4gVGhlIHBvc2l0aW9uaW5nIG9mIHBvaW50cyBvbiB0aGUgeC1heGlzIGlzIGhhbmRsZWQgYXV0b21hdGljYWxseSBieQpnZ2JpbywgdXNpbmcgdGhlIHJhbmdlcyBpbmZvcm1hdGlvbiB0byBnZXQgdGhlIGdlbm9taWMgY29vcmRpbmF0ZXMgb2YgdGhlIHJhbmdlcyBvZiBpbnRlcmVzdC4KClRvIHN0b3AgdGhlIHBsb3RzIGZyb20gYmVpbmcgdG9vIGNsdXR0ZXJlZCB3ZSB3aWxsIGNvbnNpZGVyIHRoZSB0b3AgMjAwIGdlbmVzIG9ubHkuCgpgYGB7cn0KbGlicmFyeShnZ2JpbykKdG9wMjAwIDwtIHNpZ1JlZ2lvbnNbb3JkZXIoc2lnUmVnaW9ucyRMUixkZWNyZWFzaW5nID0gVFJVRSlbMToyMDBdXQoKcGxvdEdyYW5kTGluZWFyKHRvcDIwMCAsIGFlcyh5ID0gbG9nRkMpKQoKYGBgCgpgZ2diaW9gIGhhcyBhbHRlcm5hdGVkIHRoZSBjb2xvdXJzIG9mIHRoZSBjaHJvbW9zb21lcy4gSG93ZXZlciwgYW4gYXBwZWFsaW5nIGZlYXR1cmUgb2YgYGdncGxvdDJgIGlzIHRoZSBhYmlsaXR5IHRvIG1hcCBwcm9wZXJ0aWVzIG9mIHlvdXIgcGxvdCB0byB2YXJpYWJsZXMgcHJlc2VudCBpbiB5b3VyIGRhdGEuIEZvciBleGFtcGxlLCB3ZSBjb3VsZCBjcmVhdGUgYSB2YXJpYWJsZSB0byBkaXN0aW5ndWlzaCBiZXR3ZWVuIHVwLSBhbmQgZG93bi1yZWd1bGF0ZWQgZ2VuZXMuIFRoZSB2YXJpYWJsZXMgdXNlZCBmb3IgYWVzdGhldGljIG1hcHBpbmcgbXVzdCBiZSBwcmVzZW50IGluIHRoZSBgbWNvbHNgIHNlY3Rpb24gb2YgeW91ciByYW5nZXMgb2JqZWN0LgoKYGBge3J9Cm1jb2xzKHRvcDIwMCkkVXBSZWd1bGF0ZWQgPC0gbWNvbHModG9wMjAwKSRsb2dGQyA+IDAKCnBsb3RHcmFuZExpbmVhcih0b3AyMDAsIGFlcyh5ID0gbG9nRkMsIGNvbCA9IFVwUmVndWxhdGVkKSkKYGBgCgpgcGxvdEdyYW5kTGluZWFyYCBpcyBhIHNwZWNpYWwgZnVuY3Rpb24gaW4gYGdnYmlvYCB3aXRoIHByZXNldCBvcHRpb25zIGZvciB0aGUgbWFuaGF0dGFuIHN0eWxlIG9mIHBsb3QuIE1vcmUgb2Z0ZW4sIHVzZXJzIHdpbGwgY2FsbCB0aGUgYGF1dG9wbG90YCBmdW5jdGlvbiBhbmQgYGdnYmlvYCB3aWxsIGNob29zZSB0aGUgbW9zdCBhcHByb3ByaWF0ZSBsYXlvdXQuIE9uZSBzdWNoIGxheW91dCBpcyB0aGUgKmthcnlvZ3JhbSouIAoKYGBge3J9CgphdXRvcGxvdCh0b3AyMDAsbGF5b3V0PSJrYXJ5b2dyYW0iLGFlcyhjb2xvcj1VcFJlZ3VsYXRlZCwKICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgZmlsbD1VcFJlZ3VsYXRlZCkpCgpgYGAKCgoKYGdnYmlvYCBpcyBhbHNvIGFibGUgdG8gcGxvdCB0aGUgc3RydWN0dXJlIG9mIGdlbmVzIGFjY29yZGluZyB0byBhIHBhcnRpY3VsYXIgbW9kZWwgcmVwcmVzZW50ZWQgYnkgYSBgR2Vub21pY0ZlYXR1cmVzYCBvYmplY3QuCgoKYGBge3J9CmF1dG9wbG90KHR4LCB3aGljaD1leG9bWyIyNDExNyJdXSkKYGBgCgpXZSBjYW4gZXZlbiBwbG90IHRoZSBsb2NhdGlvbiBvZiBzZXF1ZW5jaW5nIHJlYWRzIGlmIHRoZXkgaGF2ZSBiZWVuIGltcG9ydGVkIHVzaW5nIHJlYWRHQWxpZ25tZW50cwpmdW5jdGlvbiAob3Igc2ltaWxhcikuCgpgYGB7cn0KbXlyZWcgPC0gZmxhbmsocmVkdWNlKGV4b1tbIjI0MTE3Il1dKSwgMTAwMCwgYm90aCA9IFQpCmJhbSA8LSByZWFkR0FsaWdubWVudHMoZmlsZT0iYmFtL01DTDEuREcuYmFtIiwKICAgICAgICAgICAgICAgICAgICAgICBwYXJhbT1TY2FuQmFtUGFyYW0od2hpY2g9bXlyZWcpLHVzZS5uYW1lcyA9IFRSVUUpCgphdXRvcGxvdChiYW0sd2hpY2g9bXlyZWcpCmBgYAoKYGBge3J9CmF1dG9wbG90KGJhbSAsIHN0YXQgPSAiY292ZXJhZ2UiKQpgYGAKTGlrZSBnZ3Bsb3QyLCBnZ2JpbyBwbG90cyBjYW4gYmUgc2F2ZWQgYXMgb2JqZWN0cyB0aGF0IGNhbiBsYXRlciBiZSBtb2RpZmllZCwgb3IgY29tYmluZWQgdG9nZXRoZXIgdG8KZm9ybSBtb3JlIGNvbXBsaWNhdGVkIHBsb3RzLiBJZiBzYXZlZCBpbiB0aGlzIHdheSwgdGhlIHBsb3Qgd2lsbCBvbmx5IGJlIGRpc3BsYXllZCBvbiBhIHBsb3R0aW5nIGRldmljZQp3aGVuIHdlIHF1ZXJ5IHRoZSBvYmplY3QuIFRoaXMgc3RyYXRlZ3kgaXMgdXNlZnVsIHdoZW4gd2Ugd2FudCB0byBhZGQgYSBjb21tb24gZWxlbWVudCAoc3VjaCBhcwphbiBpZGVvZ3JhbSkgdG8gYSBwbG90IGNvbXBvc2l0aW9uIGFuZCBkb27igJl0IHdhbnQgdG8gcmVwZWF0IHRoZSBjb2RlIHRvIGdlbmVyYXRlIHRoZSBwbG90IGV2ZXJ5IHRpbWUuCgpgYGB7cn0KI2lkUGxvdCA8LSBwbG90SWRlb2dyYW0oZ2Vub21lID0gIm1tMTAiKQojaWRQbG90CmdlbmVNb2QgPC0gYXV0b3Bsb3QodHgsIHdoaWNoID0gbXlyZWcpCnJlYWRzMSA8LSBhdXRvcGxvdChiYW0sIHN0YXQgPSAiY292ZXJhZ2UiKQp0cmFja3MoZ2VuZU1vZCAscmVhZHMxKQpgYGAKCgo=